Questions tagged [cholesky-decomposition]

The Cholesky decomposition is a decomposition of a Hermitian, positive-definite matrix into the product of a lower triangular matrix and its conjugate transpose.

151 questions
65
votes
1 answer

Generating correlated random numbers: Why does Cholesky decomposition work?

Let's say I want to generate correlated random variables. I understand that I can use Cholesky decomposition of the correlation matrix to obtain the correlated values. If $C$ is the correlation matrix, then we can do the cholesky…
31
votes
2 answers

LU Decomposition vs. Cholesky Decomposition

What is the difference between LU Decomposition and Cholesky Decomposition about using these methods to solving linear equation systems? Could you explain the difference with a simple example? Also could you explain the differences between these…
26
votes
8 answers

Relation between Cholesky and SVD

When we have a symmetric matrix $A = LL^*$, we can obtain L using Cholesky decomposition of $A$ ($L^*$ is $L$ transposed). Can anyone tell me how we can get this same $L$ using SVD or Eigen decomposition? Thank you.
20
votes
3 answers

Generating multivariate normal samples - why Cholesky?

Hello everyone and happy new year! May all your hopes and aspirations come true and the forces of evil be confused and disoriented on the way to your house. With that out of the way... I am trying to write a computer code that gets a vector $\mu \in…
19
votes
1 answer

Cholesky of matrix plus identity

I have a positive definite matrix $A$ ($n \times n$ dimension) for which I have the Cholesky decomposition $A=LL^{'}$. I want to use this to compute a) The Cholesky decomposition of $A+c^2\times I $ where $c$ is a constant and $I$ is the identity…
16
votes
3 answers

Cholesky decomposition of the inverse of a matrix

I have the Cholesky decomposition of a matrix $M$. However, I need the Cholesky decomposition of the inverse of the matrix, $M^{-1}$. Is there a fast way to do this, without first computing $M^{-1}$? In other words, is there a relationship between…
16
votes
2 answers

Inverse of the sum of a invertible matrix with known Cholesky-decomposion and diagonal matrix

I want to ask a question about invertible matrix. Suppose there is a $n\times n$ symmetric and invertible matrix $M$, and we know its Cholesky decomposion as $M=LL'$. Then do we have an efficient way to calculate $(M+D)^{-1}$, where…
15
votes
3 answers

Why does the Cholesky decomposition requires a positive definite matrix?

Why does the Cholesky factorization requires the matrix A to be positive definite? What happens when we factorize non-positive definite matrix? Let's assume that we have a matrix A' that is not positive definite (so at least one leading principal…
13
votes
3 answers

A simple proof for the relationship between the eigenvalues of a positive definite matrix and its Cholesky decomposition

Can anyone present to me an elegant elementary proof of the relationship between the eigenvalues of a positive definite matrix and its Cholesky decomposition? More formally, suppose $\mathbf{A}$ is an $n\times n$ positive definite matrix and let…
13
votes
1 answer

How to prove the existence and uniqueness of Cholesky decomposition?

Given a real Hermitian positive-definite matrix $A$ is a decomposition of the form $A=L L^T$ where L is a lower triangular matrix with positive diagonal entries. I read some proofs about the existence of Cholesky decomposition. Most of them start…
11
votes
2 answers

Cholesky decomposition in positive semi-definite matrix

While trying to apply the algorithm described in the article: Robust adaptative metropolis algorithm with coerced acceptance rate (2011), Matti Vihola I used the a Cholesky decomposition to find $S_n$: $S_n S_n^T = S_{n-1} D_n S_{n-1}^T$ The…
10
votes
1 answer

Cholesky for non-positive definite matrices

I am trying to approximate a NPD matrix with the nearest PD form and compute its Cholesky decomposition. I know that the usual method is to perform an eigenvalue decomposition, zero out the negative eigenvalues, and recompute the eigenvalue…
10
votes
0 answers

Can I go from the LU factorization of a symmetric matrix to its Cholesky factorization, without starting over?

I mistakenly computed the LU factorization and then realized that the question asked for a Cholesky factorization, i.e., finding a lower triangular matrix $L$ such that the symmetric matrix $A$ has factorization $LL^T$. Can I modify the LU…
8
votes
1 answer

Why does the Cholesky decomposition exist?

From wikipedia, given any matrix $A$, we can sometimes decompose $A = LU$ using Gaussian elimination. Other times, a permutation matrix is needed, giving $PA = LU$. If $A$ is Hermitian positive-definite, I can show that IF no permutation matrix is…
8
votes
0 answers

Cholesky decomposition of $A+kI$ given Cholesky decomposition of A

Suppose I have the Cholesky decomposition for a symmetric matrix $A$: $$ A = L L^T $$ I wish to compute the Cholesky decomposition for $A+kI$ where $I$ is the identity and $k$ is a scalar. Is there a way to obtain this using the decomposition for…
1
2 3
10 11