A common proof of the simplicity of $A_5$ proceeds as follows.
First, note that a normal subgroup is always a union of conjugacy classes. Also, a subgroup has order dividing the size of the group by Lagrange's theorem. Any normal subgroup will contain the conjugacy class with the identity. Now if we look at unions of conjugacy classes of $A_5$ where we include $\{(1)\}$ in the union, there only two cases where the size of the union divides the order $A_5$. These are the cases where the union is all of $A_5$ or just $\{(1)\}$. Hence $A_5$ must be simple.
This same proof also works for $A_6$. But in general we cannot deduce the simplicity of $A_n$ for $n \geq 5$ with the same proof. According to this article it turns out that for example, $1 + \frac{n(n-1)(n-2)}{3}$ divides $n!/2$ when $n = 68$. Note that $\frac{n(n-1)(n-2)}{3}$ is the size of the conjugacy class of $3$-cycles in $A_n$ when $n \geq 5$.
Question: Is $n = 68$ the smallest positive integer where the proof fails? In the article they say that this "seems to be the smallest counterexample". However, counting all the possible sums of conjugacy classes of $A_n$ becomes computationally difficult very quickly (as is noted in the article). Hence actually demonstrating this might be hard.