The short answer: it's convenient.
E.g. one has the definition of local compactness: $X$ is locally compact if every point has a base of compact neighbourhoods. Or another (non-equivalent in general!) definition of local compactness: every point has a compact neighbourhood.
Or (theorem:) a space is regular iff it every point has a base of closed neighbourhoods.
Such definitions or theorems are easier to state with a general notion of neighbourhood. Also, the set of all neighbourhoods is then a filter while the open neighbourhoods are "just" a filter base, etc. This will only appeal to set theory minded people (like myself), probably. We can still say "open neighbourhood of $x$" for an open set that contains $x$, so it's easy to speciaise to that case as well.
For many definitions (like convergence, continuity) it does not matter whether we state them in terms of open neighbourhoods or general neighbourhoods. S owe can be a bit more general using the general term as well.