Okay, if a matrix RREFs to the identity, then you can express it as a product of elementary row operations and the identity, and find the inverse by going backwards, that's trivial
Going the other way is more difficult, I am struggling to show:
A matrix has an inverse $\implies$ it RREFs to the identity matrix
My work (if you can call it that) so far: contrapositive, suppose a matrix RREFs to not the identity matrix, I must show the matrix has no inverse.