From the Sylow theorems, you know that the group of order 101 is unique. Since that subgroup is unique, it is normal. Therefore, $G$ has a normal subgroup of order 101 and a subgroup of order $5$ (which might not be normal). If you continue with the Sylow theorems, you will find that the groups of this type are called semidirect products determined by maps from $\mathbb{Z}/5$ into Aut$(\mathbb{Z}/101)\simeq\mathbb{Z}/100$. There is a map from $\mathbb{Z}/5$ into $\mathbb{Z}/100$, and this gives a noncyclic group of order 505. In fact, the group can be presented as
$\langle x,y:x^5=1,y^{101}=1,xy=y^{36}x\rangle.$
One thing that you can see is that when the subgroup $\mathbb{Z}/5$ is not normal, then the group cannot be cyclic. However, one still must show that such a group exists.
– Michael Burr Mar 01 '15 at 17:32