I know that in the early stages of set theory, e.g., by Cantor and I think largely until von Neumann's formalization of the notion of "ordinal" within his set theory, ordinals were often treated as distinct from sets -- they were the types of well-ordered sets, but not identified with them. I've occasionally seen modern mentions of ordinals that suggest a similar view.
For example, in the answer to Difference Between Cantor's Ordinals and Von Neumann Ordinals?, Asaf Karagila mentions as an aside that a Cantorian conception of ordinals could correspond to taking ordinals to be an abstract category (I think I've seen the claim elsewhere, but this was just the first mention I could find). Similarly, when discussing forcing there's frequent mention of models of $\mathsf{ZFC}$ with the same ordinals. Much like talk of "the real $\in$ relation", this is at least suggestive of something like a set theory transcendent conception of ordinals.
My question is are there modern implementations of a "theory of ordinals" that are independent of any set theory (allowing, perhaps, for "artifactual" uses of set theory to provide the model theory)? I suspect that something in the realm of order theory or category theory would fit the bill, but I don't know either area well enough to navigate my way to such a theory.