Let $\mathbb F$ be a field with a non-trivial absolute value, such as $\mathbb F_p(X)$ or $\mathbb Q$ or $\mathbb Q_p$, and let $f:\mathbb F\to\mathbb F$ be a function. Limits, continuity, and derivatives are defined as usual: $\lim_{x\to a}f(x)=b$ means that for any real $\varepsilon>0$ there exists $\delta>0$ such that, for all $x\in\mathbb F$ where $0<|x-a|<\delta$, $|f(x)-b|<\varepsilon$.
We say that $f$ is $n$th-order Peano differentiable at $a$, if there's a polynomial $\sum_{k=0}^nc_kx^k$ and a function $h$ continuous at $h(0)=0$ such that
$$f(a+x)=\sum_{k=0}^nc_kx^k+x^nh(x).$$
Suppose $f$ has both ordinary derivatives and Peano derivatives up to order $n$ at $a$. Must they be proportional,
$$f^{(k)}(a)=k!\,c_k\quad?$$
Related: In characteristic $2$, can a function have a non-zero second derivative?
A function may have Peano derivatives but not ordinary derivatives of order $n$. Here's an example with $\mathbb F=\mathbb R$ (I suppose a similar example could be constructed for $\mathbb F=\mathbb Q$ using $2^{\lfloor-1/x^2\rfloor}$ on the dyadic rationals):
$$f(x)=\begin{cases}e^{-1/x^2},\quad x\in\mathbb Q\setminus\{0\}; \\ 0,\quad\text{otherwise};\end{cases}$$
this satisfies $f(0+x)=0+0x+\cdots+0x^n+x^nh(x)$ where $\lim_{x\to0}h(x)=0$. But $f''(0)$ doesn't exist, because $f'(x)$ doesn't exist in a neighbourhood of $0$, because $f(x)$ is not continuous in a neighbourhood of $0$.
Conversely, a function may have ordinary derivatives but not Peano derivatives of order $n$. An example with $\mathbb F=\mathbb Q_p$ is given here:
$$f(x)=\begin{cases}p^{2m},\quad x=p^m+yp^{2m+1},\quad y\in\mathbb Z_p,\quad m\in\mathbb N; \\ 0,\quad\text{otherwise};\end{cases}$$
this satisfies $f'(x)=0$ for all $x$, hence $f^{(n)}(0)=0$ for all $n>1$. But $\lim_{x\to0}f(x)/x^2$ doesn't exist, so $f$ can't have a $2$nd-order Peano derivative; $f(0+x)=0+0x+c_2x^2+x^2h(x)$ would imply that the limit exists as $c_2$.