Inverse images behave much more nicely than direct images. Indeed, one has the identities
$$
f^{-1}(B\cap C)=f^{-1}(B)\cap f^{-1}(C)
$$
and
$$
f^{-1}(B^c)=(f^{-1}(B))^c
$$
where ${}^c$ is the complement (relative to $X$ or $Y$). Neither of these identities hold for direct images, we only have $\subset$ in the first one. The first identity also generalizes to arbitrary unions.
If you're categorically minded, taking inverse images defines a function from the category of sets into the category of (complete) Boolean algebras, while taking direct images is merely a morphism of ordered sets.
When trying to explain where this comes from, one notices that the definition of a direct image is more complicated, in terms of the syntax. Indeed, compare
$$
f^{-1}(B):=\{x\in X: f(x)\in B\}
$$
with
$$
f(A):=\{y\in Y: \exists x\in A(f(x)=y)\}
$$
The condition that determines whether something is in $f(A)$ involves an existential quantifier, which is not the case for $f^{-1}(B)$, where the defining condition is quantifier free. And, as always, quantifiers are hard. Indeed, think of evaluating the truth value of any propositional formula. This can be done with a truth table, given enough time. Once quantifiers get into the mix, things become much harder, as they involve checking infinitely many objects.
Regarding the question of whether $f(A)$ is measurable for measurable $A$, the answer is, in general, no. This famously tripped up even Lebesgue himself, who published a faulty proof that the projection (which is continuous, even open!) of a Borel set in the plane is Borel in the line. This mistake, which involved an incorrect manipulation of $\exists$, went unnoticed for 10 years, until it was discovered by Souslin, marking the start of descriptive set theory. See here for more details.
However, not all is lost, as we have the following positive result:
Theorem: Let $X$ and $Y$ be standard Borel space (this means that the $\sigma$-algebras are induced by Polish topologies on the corresponding spaces). Suppose that $f:X\to Y$ is Borel measurable. Let $A\subset X$ be Borel measurable. If the restriction $f\mid A$ is injective, then $f(A)$ is Borel measurable.
Given the measure space $(X, \mathcal M)$ and $f$ an extended real valued function defined on $X$ then $f$ is measurable iff the set ${x \in X | f(x) > c }$ is measurable for each real number $c$.
– Alessandro Romancino May 24 '20 at 19:42