A standard way to get non-isomorphic finite groups of equal order is the following:
Write $$G=N\rtimes_\varphi H,$$ as a product of two subgroups $N,H$ of which $N\trianglelefteq G$ is normal. The multiplication in the group $G$ is defined as
$$
g_1\cdot g_2=(n_1,h_1)\cdot(n_2,h_2)=(n_1\varphi(h_1)(n_2),h_1h_2)=n_1\varphi(h_1)(n_2)h_1h_2
$$
where $\varphi :H\longrightarrow \operatorname{Aut}(N)$ is a homomorphism from $H$ to the automorphism group $\operatorname{Aut}(N)$ of $N.$ In case $\varphi =\operatorname{id}_N$ we speak of a direct product and of a semidirect product in all other cases. In case there is a group of the same order which cannot be written as a product, we have an additional example.
You can see that we get as many examples of groups of the same finite order as we have automorphisms of $N$ available.
In case of the Klein 4-group we have $G=\mathbb{Z}_2\rtimes_\varphi \mathbb{Z}_2$ and $\operatorname{Aut}(\mathbb{Z}_2)=\{\operatorname{id}_{\mathbb{Z}_2}\}\cong \{1\}$ only one automorphism, hence a direct product. However, $G=\mathbb{Z}_4$ is the other group with four elements. It cannot be written as a product of subgroups because e.g. the single element $3$ generates the entire group: $\{3,3+3=6=2,2+3=5=1,1+3=4=0\}.$