Questions tagged [cumulants]

Use this tag for questions about those quantities that provide an alternative to the moments of a probability distribution.

In probability theory and statistics, cumulants of a probability distribution are quantities that provide an alternative to moments of the distribution. Moments determine cumulants in the sense that any two probability distributions whose moments are identical have identical cumulants, and, similarly, cumulants determine moments.

The first cumulant is mean, the second cumulant is variance, and the third cumulant is the same as the third central moment, but greater order cumulants are not equal to central moments. In some cases, theoretical treatments of problems in terms of cumulants are simpler than treatments using moments. In particular, when two or more random variables are statistically independent, the $n$th-order cumulant of their sum is equal to the sum of their $n$th-order cumulants. Third- and greater-order cumulants of a normal distribution are zero; it is the only distribution with that property.

Cumulants of a random variable $X$ can be defined using the cumulant generating function $K(t),$ which is the natural logarithm of the moment generating function. With $M(t)$ as the moment generating function, $M(t) = \mathrm E \left[ e^{tX} \right].$ Taking the natural logarithm of both sides yields $K(t) = \log \mathrm E \left[ e^{tX} \right].$

Cumulants $\kappa_n$ are obtained from a power series expansion of the cumulant generating function: $$K(t) = \sum_{n=1}^{\infty} \kappa_n \frac{t^n}{n!} = \mu t + \sigma^2\frac {t^2}2 + \cdots.$$

That expansion is a Maclaurin series, so the $n$th cumulant can be obtained by differentiating the above expansion $n$ times and evaluating the result at zero: $\kappa_n = K^n(0).$

If the moment generating function does not exist, cumulants can be defined in terms of the relationship between cumulants and moments.

Just as for moments, where joint moments are used for collections of random variables, it is possible to define joint cumulants.

63 questions
9
votes
0 answers

Quantify the similarity between a polynomial roots and the roots of its derivatives

On $\mathbb{C}[X]$, many theorems and conjectures deal with relations between a polynomial roots and the roots of its derivatives. When looking at a graph, the derivative roots distribution somewhat mimics the distribution of the polynomial roots.…
8
votes
3 answers

Are cumulants the only additive functions of independent random variables?

For a random variable $X$, the cumulant generating function $CGF_X$ is defined as $CGF_X(t)=\log Ee^{tX}$, and the nth cumulant $k_n(X)$ is defined as the coefficient of $t^n/n!$ in the corresponding power series. The cumulant $k_n$ has the…
8
votes
1 answer

Distribution with many cumulants vanishing

Let $X$ be a random variable. It is well-known that $X$ is normally distributed if and only if its last cumulants $\kappa_3 = \kappa_4 = ... = 0$ vanish. I was wondering if there are standard distributions satisfying $\kappa_m = ... = \kappa_n = 0$…
Marcel
  • 909
6
votes
1 answer

Bound for cumulants of bounded random variables

Let $X$ be a random variable taking values in $[-1,1]$. The cumulant generating function is defined as $$ K(t) = \log \mathbb{E} [e^{tX}], $$ and the cumulants of $X$ are $$ \kappa_n = K^{(n)}(0). $$ I would like to know the best possible bounds…
felipeh
  • 4,004
6
votes
0 answers

Moment Generating Function for $r$th central moment

When using moment generating functions, to find the $n$th raw moment ("$n$th moment about the origin"), you take the $n$th derivative of the MGF and evaluate at $t=0$. To find the $m$th central moment ("$m$th moment about the mean"), e.g. $m=2$ for…
4
votes
0 answers

Positivity and Negativity of Cumulants

There's few examples of distributions whose cumulants can be computed relatively easily. Normal random variables are of course the easiest: the first cumulant is the mean and the second is the variance. All other cumulants vanish. Another relatively…
4
votes
1 answer

Cumulants vs. moments

In high order statistics, what is the intuition for the difference between cumulants and moments? What does any of them measure and what is the intuition to use one of them over the other? Specifically, I am following this paper, and I am trying to…
havakok
  • 1,171
4
votes
0 answers

Why is the S-transform necessary in free probability?

In classical probability, adding two independent random variables corresponds to adding their cumulant generating functions, i.e. the logarithms of their Fourier transforms. In Voiculescu's free probability, adding two freely independent random…
keej
  • 1,277
  • 9
  • 28
3
votes
0 answers

What did Rota mean by "one can define cumulants relative to any sequence of binomial type"?

$\newcommand{\E}{\mathbb{E}}$ Near the end of "Finite Operator Calculus" (1976), G.C. Rota writes: Note that one can define cumulants relative to any sequence of binomial type, e.g. the factorial cumulants (Kendall and Stuart). The book he makes…
3
votes
2 answers

Expression for the cumulant generating function

Given the moment generating function of a random variable $X$, $$M_X (t) = \mathbb{E}[e^{tX}],$$ one defines the cumulant generating function, $$K(t) = \log \mathbb{E}[e^{tX}].$$ One then states that the right-hand side (RHS) can be written as a…
user996159
  • 938
  • 4
  • 11
3
votes
0 answers

Relative magnitude of moments of a probability density to its cumulants

Consider a probability density $f(X)$ of some random variable $X\leq0$, with moments $\mu_n'=\left< X ^n \right>$ and cumulants $\kappa_n$. I aim to proof $$ \Delta_n := (-1)^n \left(\mu_n'- \frac{\kappa_n}{(n-2)!} \right) \geq 0 \quad \text{for…
3
votes
1 answer

What is a bispectrum analysis?

I am in the atmospheric sciences and when I read papers on non linear interactions I came up with this term - bispectrum. It is not very clear what a 2nd order cumulant is . So assuming I have wind speed magnitude across a latitude circle as a…
user297514
3
votes
0 answers

Inequality between standardized cumulants: $\rho_4\geq\rho_3^2-2$

Suppose that $X$ is a random varible with moments $\mu_1'$, $\mu_2'$, $\mu_3'$, $\mu_4'$ and central moments $\mu_1=0$, $\mu_2=\text{Var}(X)$, $\mu_3$ and $\mu_4$. Define the…
3
votes
1 answer

Additivity of cumulants of dependent random variables?

What sequences of real-valued random variables $X_1,X_2,X_3,\ldots$ exist for which for all $n$ and all $k$ $$ \operatorname{cum}_k (X_1+\cdots+X_n) = \operatorname{cum}_k(X_1)+\cdots + \operatorname{cum}_k(X_n) $$ where $\operatorname{cum}_k$ is…
2
votes
2 answers

Cumulant generating functions: reference for them being analytic

Let $f(x)$ be some probability density on $R$. Its cumulant generating function (CGF) is: $$ t \rightarrow C(t) = \log \left[ \int f(x) \exp(t x) dx \right] $$ I'm fairly certain that, on any open region $U$ where $C(t)$ is finite it is also…
1
2 3 4 5