2

Let $f(x)$ be some probability density on $R$. Its cumulant generating function (CGF) is:

$$ t \rightarrow C(t) = \log \left[ \int f(x) \exp(t x) dx \right] $$

I'm fairly certain that, on any open region $U$ where $C(t)$ is finite it is also analytic (on top of being convex and infinitely differentiable which are also classic results).

  1. Inside that region, we can define a complex extension:

    $$ z \rightarrow \log \left[ \int f(x) \exp(z x) dx \right] $$

  2. This complex extension is infinitely differentiable, same as the CGT.

  3. The complex extension is thus holomorphic, implying it is analytic.

  4. The $C(t)$ function is thus analytic.

Given that this such a simple and interesting example, I'm fairly certain that it should be found in at least some classical textbooks of either probability, statistics or on the Laplace transform, but I can't find anything in the modern textbooks I've consulted.

2 Answers2

1

The first issue is that there no reason a priori that such a domain $U$ exists. Consider for example the Cauchy distribution: $$ f(x) = \frac1{\pi(1+x^2)} $$ At best, you can define $C$ on the imaginary line, for $\omega\in\mathbb R$: $$ C(i\omega) = -|\omega| $$ There is therefore no analyticity to consider.

In general you can start from the moment generating function: $$ M(t) = \int f(x)e^{tx}dx $$ You know that there is $t_-\leq0\leq t_+$ such that in the domain $U =\{t\in\mathbb C|t_-<\Re t<t_+\}$, $M$ is defined and analytic. It is the continuous analogue of the inner and outer radii of convergence for Laurent series. The previous example shows that you can have $t_+=t_-=0$. Now assume in the following that $t_-<t_+$. Since $M$ is defined and analytic on $U$, $C = \ln M$ is defined and analytic on $U$ minus the isolated zeros of $M$ ($M\neq 0$) which is still an open set. In fact, by positivity of $f$, you know that $C$ is defined on the interval $(t_-,t_+)$ where it is convex. Furthermore, since $M$ is continuous and $C$ is non zero on the interval, $M$ is still non zero in a neighborhood of the interval, so $C$ is defined on such a neighbourhood (i.e. zeros of $M$ are at a finite distance from $(t_-,t_+)$). You can even extend the domain of definition if you want to by analytic continuation.

For example, consider the Laplace distribution: $$ f(x) = \frac12e^{-|x|} $$ with $H$ the Heaviside function. You have: $$ M(t) = \frac1{1-t^2} $$ with $t_\pm = \pm1$ and: $$ C(t) = -\ln(1-t^2) $$ You can extend both $M,C$ to the entire complex plane minus the poles at $\pm t$.

In general, if you want to reduce to the Laplace transform, you need to assume that the random variable is non negative almost surely, i.e. $f$ is supported on $\mathbb R_+$. You therefore automatically have $t_- = -\infty$ and you are guaranteed to have a non trivial domain where $C$ is analytic.

LPZ
  • 6,049
0
  1. Clarifying the question, it is important to note that the MGF and CGF might be infinite for all $t \neq 0$. In order for the MGF and CGF to be defined, the density must have faster-than-exponential decay in the tails.

  2. If $M(a)$ and $M(b)$ are both finite, then $M$ is finite on the interval $[a,b]$, from Holder's inequality.

  3. If $M(a)$ and $M(b)$ are both finite, then $M$ is analytical on the interior of the interval $]a, b[$. The proof relies on proving that the complex extension of $M$ is holomorphic. Apparently, a fairly fast proof from Morera's theorem is possible (I didn't find a ref). I prefer the detailed proof in [Brown] which shows that $M$ is differentiable.

  4. Since $M$ is both analytic and stricly positive on $]a, b[$, $C = \log M$ is analytic on $]a, b[$: the composition of analytic functions is also analytic.

A great reference is chapter 2 of this book by LD Brown: Fundamentals of statistical exponential families with applications in statistical decision theory, fully available from project euclid. It deals with the more general question of proving these properties for the normalizing function of an exponential family, which was the underlying problem I was actually interested in.