Your calculations are correct. Your interpretation is not.
You have case 1. And you have case 2. So the solution was be either a solution to Case 1 OR a solution to case 2.
Each case has an hypotheses and conclusion. SO the solution to each case will be when both hypothesis AND conclusion it true.
In case 1: Your hypothesis is $x > 3$ and your conclusion is $-3 \ge -5$ (which is always true). So the solution to case 1 is when $x > 3$ AND $-3 \ge -5$. That is to say the solution to case 1 is when $x > 3$.
In case 2: Your hypothesis is $x \le 3$ and your conclusion is $x \le 4$. So the solution to case 2 is when $x \le 3$ AND $x \le 4$. $x\le 4$ is a less restrictive instance that is entirely covered by instance $x\le 3$. So the solution to case 2 is when $x \le 3$.
So the complete solution is a solution to Case 1 OR a solution to Case 2.
That is, a solution is when $x < 3$ OR $x \ge 3$. And that occurs.... always.
Evey real number is a solution.
...
But I can see how the logic can be abstract to blinding. Best to do something a bit more direct and hands on that is satisfying to your comfort level of abstraction.
One way, but not the only way, is to not think of unions and intersections but critical points and running tallies.
$3-x$ "goes" "from" negative to postive at $x=3$ so consider $x < 3$. Then $|3-x|=3-x \ge x-5\implies x\le 4$ but that's always the case when $x < 3$. So every $x<3$ makes this equation true.
If $x=3$ then $|3-x|=0$ and $x-5=-3$ and obviously $0 \ge -3$ so it's true.
And finally if $x > 3$ then $|3-x| = x-3 \ge x-5\implies -3 \ge -5$ and this is always true.
Putting it together its true when $x < 3$, it's true when $x=3$, and it's true with $x>3$.
So it is always true.
That's the exact same reasoning as above but... maybe a bit more convincing and less abstract.