Let $(X,\mathfrak B)$ be a measurable space such that $\{x\}\in \mathfrak B$ for all $x\in X$, and let $\mu$ be a positive measure on this space such that $$ \mu(B) \in\{0,1\} \quad\text{for all }B\in \mathfrak B. $$ What are the mildest conditions on $(X,\mathfrak B)$ that imply that $\mu =\delta_x$ for some $x\in X$?
It is known to hold for $\Bbb R$ with a Borel $\sigma$-algebra, and I believe it fairly easy extends to $\Bbb R^n$. I wonder, though, whether it holds at least for locally compact Polish spaces, or perhaps for more general case. I am also interested in examples of spaces where such statement does not hold.