Let $V$ be some vector space and $P$ a projection onto a subvectorspace $C \subset V$. Let $\mathcal L$ be a set of unitary operators on $V$ satisfying $AP = PAP$ for all $A \in \mathcal L$. In this paper, the authors prove that $\mathcal L$ is a group. The step in their proof which confuses me a bit is when they show that this set contains inverses. Suppose $A \in \mathcal L$. They show $$(PA^\dagger P)(PAP) = PA^\dagger P^2AP = PA^\dagger (PAP) = PA^\dagger A P = P,$$ which shows that $PA^\dagger P$ is the inverse of $PAP$ on the subspace $C$. They claim that because of this, $P = (PAP)(PA^\dagger P)$, i.e. that $PAP$ and $PA^\dagger P$ commute, and use that fact to complete the proof.
I don't fully understand what they mean when they say that $PA^\dagger P$ is the inverse of $PAP$ on a subspace. I see that $P$ acts as the identity on the subspace, so I can see what they are getting at but I don't see why that guarantees that we can flip around the product. An explanation or proof of this fact would be appreciated!