there are many ways to define cardinals, so I'll present some of them and answer your question accordingly (spoiler alert : the answer is always no)
Using initial ordinals : modulo $AC$, mathematicians only use "initial ordinals" to define cardinals, that is, ordinals that aren't equipotent with any lesser ordinal. With that definition, using $AC$, any set is equipotent with one unique initial ordinal, i.e. cardinal. Then it's a classical theorem to show that there is no set of all cardinals : any set of cardinals is bounded above.
With your definition of cardinals : as has been noted in the comments, with the exact definition you gave, a cardinal itself isn't even a set, so it wouldn't even make sense to talk about a set of cardinals, let alone the set of all cardinals.
However one can use a trick to smooth it up a bit : using the Von Neumann hierarchy. With the axiom of foundation, one can show that for any $x$, there is an ordinal $\alpha$ such that $x\in V_\alpha$, and then one can say : for any $x$, let $\alpha$ be the least ordinal such that there exists $y\in V_\alpha$ equipotent with $x$, and then you can let the equivalence class of $y$ in $V_\alpha$ for the relation "there exists a bijection between" be denoted by $card(x)$. This makes cardinals into sets, and has the same expression power as your first definition. And then, with this definition, one can answer your question in the same way : no there isn't a set of all cardinals. Indeed, for any distinct initial ordinals $\alpha,\beta$, one would have $card(\alpha) \neq card(\beta)$, and thus if there were a set of all cardinals, there would be a set of all initial ordinals, which is a contradiction.
Notes :
- for any ordinal $\alpha$, there is a least ordinal equipotent with $\alpha$ (indeed, there are ordinals equipotent with $\alpha$, and so by the well ordering of ordinals, there is a least one). Ordinals that aren't equipotent with any strictly smaller ordinal are initial ordinals (usually cardinals, but as here there is a risk of confusion, I used the word "initial ordinal"). There isn't a set of all initial ordinals
-the Von Neumann hierarchy is defined as follows, by induction : for any ordinal $\alpha$, let $V_\alpha = \displaystyle\bigcup_{\beta <\alpha} \mathcal{P}(V_\beta)$, where $\mathcal{P}(X)$ is the powerset of $X$. Assuming the axiom of foundation, for all $x$, there is $\alpha$ with $x\in V_\alpha$.