Research mathematicians are in the habit of constantly forming opinions about a "level of belief" that the mathematician attaches to various hypotheses (that is, mathematical statements whose truth value is unknown) that are related to the problem one is trying to make progress on. These opinions are based on intuition, factoring in what the mathematician currently knows about the problem, and their accumulated body of experience with research and problem-solving.
Developing such opinions, keeping track of them, and updating them as one learns more about the problem one is trying to solve, are all critical skills that have a large effect on the ability of the mathematician to make progress and come up with good research.
These "levels of belief" are not "probabilities" in any real sense, except in the very loose sense that the most successful mathematicians have developed efficient methods for accurately predicting whether hypotheses are true or not. These successful mathematicians don't always get it right, but they typically get it right more frequently than less successful mathematicians.
When mathematicians talk about research with other mathematicians, they often want to communicate how strong their level of belief in some mathematical statement being discussed is. Being human, they sometimes employ imprecise, metaphorical language. In such a setting it is not uncommon for a mathematician to use the language of probability and say that a mathematical statement is "probably" true. Everyone understands that this is not a literal statement about probabilities; rather, it is simply shorthand for the fact that the mathematician has a high level of (intuitive, non-probabilistic) belief in the statement.
Two final thoughts related to your specific example of the Collatz conjecture:
The idea I mentioned that the most successful mathematicians are reliable predictors of what is "probably" true applies to "everyday" hypotheses - the sort of small, non-famous questions that come up every time one is working on a research problem. If you have a discussion with a famous mathematician about some research problem and 10 "everyday hypotheses" come up that the famous mathematician says are "probably" true, I'd wager they will be right about at least 7 or 8 of the 10.
By contrast, in the context of a famous problem like the Collatz conjecture, I don't think anyone in the world -- even the smartest mathematicians alive -- can reliably predict whether the conjecture is true or not. The problem is that hard, and that different from anything that any mathematician who has ever lived has ever successfully understood, that personally, I wouldn't assume that any mathematician's opinion about it, however famous or successful that mathematician is, is a reliable indicator of anything. (I mean the opinion by itself - of course, the reasons that led that famous mathematician to arrive at their opinion may be good ones that make the opinion more likely than not to be true.)
Another issue with your example is that the Collatz conjecture is a conjecture. When a mathematical statement becomes a widely known conjecture, the fact that it is referred to as a conjecture is already an indication that there is a widely held belief that it is "probably" true, in the same sense discussed above that most serious mathematicians who have thought about it have a reasonably high level of belief that it's true. In the case of the Collatz conjecture, the reason for this is that we have some nice heuristic arguments supporting it, and strong numerical evidence, whereas no one has proposed any convincing arguments for why it shouldn't be true.
For this reason, the statement "the Collatz conjecture is probably true" is effectively a tautology. Of course, there are contexts where it would make sense for a mathematician to say something like that, but it still comes across as a bit redundant and funny to my ears.