In general, it holds that: $$f(x_0+\Delta x)\approx f(x_0)+f'(x_0)\cdot \Delta x$$ Clearly, an $e(\Delta x)$ error is made in the approximation.
Let us consider the equation $$f(x_0+\Delta x)-f(x_0)=f'(x_0)\cdot \Delta x + e(\Delta x)\cdot \Delta x$$ This equation tells us that the true increment of the function, which is a variable quantity dependent on $\Delta x$, is equal to the sum of the linear increment calculated on the tangent line and an error. It is not certain that $f'(x_0)\cdot \Delta x$ is a good approximation of $\Delta y$ in a neighborhood of $x_0$. However, it turns out that:
- the error $e(\Delta x)\cdot \Delta x$ is infinitesimal for $\Delta x \to 0$.
- the error $e(\Delta x)\cdot \Delta x$ is an infinitesimal of higher order than $\Delta x$.
Thus, there certainly exists a neighborhood of $x_0$ in which $e(\Delta x)\cdot \Delta x$ is less than the increment $\Delta x$ and therefore this ensures that the approximation is good since, for $ \Delta x$ small enough, the error is limited by the increment itself.
Is it a correct interpretation of differential approximation? If it is, is there an explicit expression for the error made?