For all real numbers $x,$ there is some real number $y$ with $y = x^2$
In the given sentence above, the word ‘with’ is introducing a condition, so I too would mentally replace it with the phrase ‘such that’. Notice that it is also implicitly the ‘AND’ operator: “....there exists some number $y$ such that $y$ is real AND $y = x^2$.”
On a tangential note, the words ‘with’ and ‘where’ should be avoided when using either of them introduces ambiguity:
What does the word ‘with’ mean in mathematics?
What does the word ‘where’ mean in mathematics?
A recent example of such ambiguity goes
If $p$ is prime, then $\binom p k=np$ where $\color\red{n\in\mathbb Z}$ and $\color\red{0<k<p}.$
The intended sentence, styled better, is
For each prime number $p$ and each $k{\in}\{1,2,\ldots,p-1\},$
there exists some $n{\in}\mathbb Z$ such that $\binom p k=np.$
For each $p{,}k{\in}\mathbb Z,$
$\quad$ if $\:p$ is prime and $0<k<p,$
$\quad$ then there exists an $n{\in}\mathbb Z$ such that $\binom p k=np.$
$\forall p{,}k{\in}\mathbb Z\:\:\exists \color\red{n{\in}\mathbb Z}\:\Big((p$ is prime and $\color\red{0<k<p})\implies\binom p k=np\Big).$
Apart from the ambiguity of the order of quantifiers, observe that that single instance of the word ‘where’ (here, ‘with’ might have been written in lieu) is alternately signalling existential quantification and implication.
Note that here, unlike in the first example, ‘with’/‘where’ is not replaceable with ‘such that’.