His argument is that if a whole number of bricks fits inside of $12$, then a whole number of bricks also fits inside of $12+12$. Is it clear to you why this is true?
Now if a whole number of the same kind of brick fits inside $32$, then we can remove the whole number of bricks that fit inside $12+12$ from the bricks that fit inside $32$, and the number of bricks that fit inside of the remainder, $8$, will also be a whole number.
So whatever the size of the brick is, if a whole number of that brick fits inside both $12$ and $32$, then a whole number of that brick will fit inside $8$.
If you follow this argument, there is no need to rule out $11$, $10$, and $9$. You ask how you can be sure none of these numbers will be a factor of both $32$ and $12$, but that is the wrong question. After all, $8$ is not a factor of both $32$ and $12$ either. So being a factor of both $32$ and $12$ is not the reason for considering $8$. To repeat, the reason for considering $8$ is that any brick that fits inside of both $12$ and $32$ also fits inside of $8$.