TL;DR
There are rngs that aren't commutative of every finite order that is not squarefree.
There are rings that aren't commutative of every finite order that is not cubefree.
The smallest a noncommutative ring without identity can be is $4$ elements: see this post for an explanation.
It is obvious how to repeat this feat for any prime $p$ so that you have a noncommutative rng of order $p^2$ for any prime.
Then you have a noncommutative rng for any nonsquarefree number, because you just do the product of you noncommutative rng times $\mathbb Z_n$ for some strategically chosen $n$.
If the order is squarefree, then its underlying abelian group is necessarily cyclic. This implies the ring is commutative since you are just multiplying things of the form $m\cdot c$ where $m$ is a natural number and $c$ is the generator.
Trying to do the same thing for rings with identity, it’s immediately clear that you have noncommutative rings of order $p^3$ for any prime(namely the upper triangular 2 by 2 matrices over finite fields), and so all noncubefree orders are covered.
It is also known that all rings of order $p^2$ (with identity obviously) are commutative.
A la this answer, you can argue that the subgroup of elements of additive order divisible by $p$ is an ideal and that the subgroup of elements of additive not divisible by $p$ is another ideal. Furthermore, they have intersection $\{0\}$ and their sum generates the whole ring, so in fact the representation is a direct sum of ideals. Repeating this, you can eventually decompose the ring into a product of rings of order $p^2$ or $p$ for distinct primes $p$. Since these are all necessarily commutative, the whole ring is commutative.
PS: thanks for using my site.