We may have a good notion of arc length even for some nonregular (or not even differentiable) curves; all we need (by definition) is that the curve $a\colon[0,b]\to \mathbb R^n$ is rectifiable, that is:
$$ l(a):=\sup\{\,d(a(0),a(t_1))+d(a(t_1),a(t_2))+\ldots+d(a(t_{n}),a(b))\mid 0<t_1<\ldots<t_n<b\,\}$$
exists (is finite). For the case you mention, this supremum definition coincides with the integral definition, of course.
This $l$ gives us a map $\ell\colon[0,b]\to[0,\infty)$ given by $\ell(t)=l(a|_{[0,t]})$ (because automatically all these restrictions are also rectifiable). Then $\ell(0)=0$, $\ell(b)=l(a)$, $\ell$ is continuous and strictly increasing. Thus $\ell^{-1}\colon[0,l(a)]\to[0,b]$ exists and allows us to reparametrize our curve as $\hat a=a\circ\ell^{-1}\colon[0,l(a)]\to\mathbb R^n$. This is reparametrization by arc length. With this the arc length from $\hat a(t_1)$ to $\hat a(t_2)$ is always $t_2-t_1$ for $0\le t_1\le t_2\le l(a)$.