The notion of completeness is mosty inspired on the reasons why we have the real numbers as a basic system, and not just the rationals $\Bbb Q$: the Greeks already found that there are line segments that could not be rational length ($\sqrt{2}$ e.g., the suspected about $\pi$, but could not prove that), but that could be approximated by rationals (e.g. Archimedes' inscribed polygons etc.). But the Greeks could't make the step to completeness at the time: they had an idea that a line segments is complete (every point you "see" must exist somehow, but not of limits : limit process yes, but you couldn't "reach" the limit, Aristotle said there as no actual infinity, just potential infinite... So philosophically they weren't ready for it, as it were.
In the 19th century Cantor (and Dedekind and others) formalised how to construct real numbers as a "completion" of rational numbers (so that they could prove the consistency of the real number system, of which mathematicians already used completeness-like properties: e.g. that all square roots, and roots of polynomials (algebraic numbers) somehow existed. Cantor used rational Cauchy sequences that have no rational limit as a witness to the "holes" in the rationals: numbers that "should" exist, but didn't in the rationals. Dedekind did a similar thing for order ($\sqrt{2}$ as a supremum of a set of rationals that has no supremum in the rationals).
The idea was so useful (because it allows to prove the consistency of $\Bbb R$) that it was generalised to all metric (and uniform spaces) to achieve similar results: to get enough elements to be useful, in a way. We have existence theorems in complete spaces that do not hold in general: Tarski's fixed point theorem, Banach's fixed point theorem, the intermediate value theorem, the fact that bounded continuous functions achieve their max or min, all direct or indirect consequences of completeness.