Let $G$ be a group, one might ask if there always exist a group $H$ such that $G\cong\text{Aut}(H)$. The answer for this is no. See this answer for counterexamples, which explains that if $G$ is a finite non-trivial group then an odd cardinality is an obstruction for $G$ to be an automorphism group, or in an alternative sense, that every non-trivial finite automorphism group has even cardinality.
Is there a nice set of necessary conditions $G$ must satisfy for this to be true?
If the general case is too difficult, I'm also accepting answers for finite groups or for inner automorphisms.