Im studying a basic differential geometry course this semester. In the class, we defined the concept of covariant derivative (connection) as a function which takes 2 vectors fields into a vector field and satisfies some algebraic properties of derivative (linearity, additivity and product rule). From this definition we showed that the connection can be specified by the Christoffel symbols. The covariant derivative "should be" a way of differentiating vectors fields along vector fields. However, there are infinite covariant derivatives on any surface, so using a random one wont make sense. We proved the "fundamental theorem of Riemmanian geometry" - existence and uniqueness of Levi-Civita connection. Except for the nice properties of the Levi-Civita connection - why should I believe it is actually a good way to differentiate vector fields? An example from analytical mechanics could be great since Im familiar with the subject and didnt learn general relativity yet.
Another concern resulting from the first one is "Why (in what sense) is parallel transport parallel?". Parallel transport along a curve is defined using covariant derivative along the velocity field of the curve. In the euclidean space, the definition makes perfect sense - parallel transport is actually parallel. In other surfaces, the covariant derivative is 0, and I didn't find any geometric intuition about "what is actually parallel".
Thanks, Tsuf.