The notes I'm using to study group theory make a remark that another appropriate name for the "orbit stabiliser theorem" is the "first isomorphism theorem for group actions". For reference, here are the two theorems:
First isomorphism theorem: let $\phi: G \to H$ be a group homomorphism with kernel $K$. Then $G / K \cong \text{Image}(\phi)$. The isomorphism is given by $\psi: G / K \to \text{Image}(\phi)$ with $\psi(gK) = \phi (g)$.
Orbit stabiliser theorem: let $G$ be a group acting on a set $X$. Let $x \in X$. Then the map $\phi: G / \text{Stab} (x) \to \text{Orb} (x)$ where $g \: \text{Stab} (x) \mapsto gx$ is a bijection. Also, if $G$ is finite, then $|G| = | \text{Stab} (x) | | \text{Orb} (x) |$.
I can see why the orbit stabiliser theorem is like the first isomorphism theorem, especially when considering that the stabiliser fixes points (i.e. for the stabiliser, the group action is the same as the identity action), so the stabiliser is a kind of analogue to the kernel. Similarly, the orbit is a bit like the image of a map.
What I want is to understand how they're analogous in a more rigorous way, and maybe if any results can be derived for group actions in much the same way as the second and third isomorphism theorems and the correspondence theorem can be derived from the first isomorphism theorem.