Using a very hand-wavy argument, I convinced myself that if, instead of $f(x)=\ln{x}$, we let $f(x)=\sqrt{x}$, we should still get something finite and small. Wasn't really sure where to start to prove it, so ran a program to see what happens for large N instead. $$ L = \lim \limits_{N \to \infty} \sum_{n=1}^N \frac{1}{2\sqrt{n}} -\sqrt{N} $$
It seems like $L$ approaches about $-0.73018$ but couldn't really tell if it wasn't just running away to negative infinity really really slowly. What tactics might we use to prove/disprove convergence here?
Edit: I've since discovered that this number is exactly $\frac{1}{2}\zeta(\frac{1}{2})$