Let $ H $ be a Hilbert space, and let $\{x_k \}_{k\in \mathbb{N}}$ be an orthogonal subset of $H$. If for every $y\in H$, $\sum \left<x_k, y\right>$ converges, then $ \sum x_k $ converges too.
I found it as a theorem in functional analysis by Rudin (second edition, section 12.6 pag. 309) but I can't use the Banach-Steinhaus theorem because it is an advanced theorem (I have not seen it yet). Do you know a simpler proof of this theorem?