I came across the following example.
Let $\mu_0$ be a finitely additive probability measure defined on every subset of $\mathbb N$ such that $\mu_0(A)=0$ if $A$ is finite. For $n \geq 1$, let $\mu_n$ be point mass at $n$, i.e. the probability measure defined for every subset of $\mathbb N$ by $\mu_n(\{n\})=1$. Let
$$\mu = \sum_{n=0}^\infty \frac{1}{2^{n+1}} \mu_n$$
Claim $\mu$ does not take the value $1/2$.
Here's what I see. If $A$ is finite, then $\mu_0(A)=0$ and $\sum_{n \geq 1} 1/2^{n+1} \mu_n(A) < 1/2$ because all but finitely many terms in the series are $0$, so $\mu(A) < 1/2$. If $A$ is co-finite, then $\mu_0(A)=1$ and $\sum_{n \geq 1} 1/2^{n+1} \mu_n(A) > 0$ because infinitely many terms in the series are positive, so $\mu(A) > 1/2$.
How to conclude for infinite $A$ with infinite complement? I guess I'm failing to grasp something about the possible values that sub-series of $\sum_{n \geq 1} 1/2^{n+1}$ can take.
Added. The reasoning above goes through for the case where $\mu_0(A)=0$, whether or not $A$ is finite, and the case where $\mu_0(A)=1$, whether or not $A$ is co-finite. So, really, my question is how to conclude when $\mu_0(A) \in (0,1)$.