Looking at the proof of the Law of large numbers, you can tell it doesn't refer directly to the definition of expected value.
I know it's wrong to assume the LLN would hold with a different definition of $E[X]$, but my question is which part of the proof exactly would be invalid if we chose a different definition.
In the proof above nothing would change. So one of the following would have to get broken in that case: Markov's inequality or Chebyshev inequality which uses Markov's inequaliy. Could anyone tell which theorem wouldn't hold with a different definition of expectation?
The LLN proves that long time average converges to what's currently defined as expected value. If we change the definition of expected value, it will simply be a different number, so LLN can't hold with any different definition of $E[X]$. If a series converges to, say, $n$, it cant' converge to $2n$ or $3.14$ or anything else at the same time. But my question is which part of the proof of LLN would get broken (I know something has to break there).