15

I did the following analysis for $2\times2$ real idempotent (i.e. $A^2=A$) matrices: $$ \begin{bmatrix}a&b\\c&d\end{bmatrix}^2=\begin{bmatrix}a^2+bc&(a+d)b\\(a+d)c&bc+d^2\end{bmatrix}=\begin{bmatrix}a&b\\c&d\end{bmatrix} $$ So in particular we have $(a+d)c=c$ and $(a+d)b=b$ so if either $b$ or $c$ is nonzero we have $a+d=1$. We also see that $a$ and $d$ both satisfy the equation $x^2+bc=x\iff x^2-x+bc=0$ which is a quadratic equation having solutions $$ x=\frac{1\pm\sqrt{1-4bc}}{2}=0.5\pm\sqrt{0.25-bc} $$ But this is only possible if $bc\leq 0.25$ for otherwise the above expression is not real. This gives us the following cases:

CASE 1: If $b,c=0$ we have $x\in\{0,1\}$ and since $a+d=1$ is unnecessary we have four possibilities: $(a,d)\in\{(0,0),(1,0),(0,1),(1,1)\}$.

CASE 2: If $bc=0.25$ we have $x=0.5$ so $a=d=0.5$.

CASE 3: If $bc<0.25$ yet $(b,c)\neq(0,0)$ we have $x\in L=\{0.5-\sqrt{0.25-bc},0.5+\sqrt{0.25-bc}\}$ and to have $a+d=1$ we must have $\{a,d\}=L$ so that if $a$ is one solution, then $d$ is forced to be the other solution. Or the other way around.

The cases can be illustrated via the following diagram graphing the hyperbola $xy=0.25$ corresponding to CASE 2, the area $xy<0.25$ corresponding to CASE 3, and the point $(0.0)$ corresponding to CASE 1:

enter image description here

The blue bands show the graphs of $xy=k$ for $k=0.05$ to $0.20$ and the cyan bands show $xy=k$ for $k=-0.05,-0.10,...$ For instance one could choose $(b,c)=(3.75,-1)$ so that $\sqrt{0.25-bc}=2$ thus rendering $x=0.5\pm 2=-1.5$ and $2.5$ and form the matrix $$ A=\begin{bmatrix}-1.5&3.75\\-1&2.5\end{bmatrix} $$ which will then be idempotent, as an example of CASE 3.

QUESTIONs:

  1. Can similar descriptions be derived for $3\times 3$ matrices?
  2. Is this a well known description of idempotent $2\times 2$ matrices?
String
  • 18,838
  • 3
    Regarding your second question: The description you derived is basically one following from the minimal polynomial. We have either $A=1$, $A=0$ or the minimal polynomial is $x^2-x$. In the latter case we have $\mathrm{det}(A)=0$ and $\mathrm{trace}(A)=1$ which more or less implies your description. – Sebastian Schoennenbeck Aug 21 '14 at 06:41
  • @SebastianSchoennenbeck: Thank you for your comment! It saves us from calculating $A^2$ thus placing us at the 4th-5th line of my account where $a+d=1$ and $x^2-x+bc=0$ have been established. – String Aug 21 '14 at 07:04
  • I must say your question is presented beautifully! *Awesome* graphics! Regards. – Robert Lewis Aug 25 '14 at 21:22
  • I read the your statement in your user profile! *Beautiful!* I would upvote it if I could! – Robert Lewis Aug 26 '14 at 04:38
  • @RobertLewis: Making diagrams is "my thing" as you can see for instance in this brilliant answer by Christian Blatter, where I added the dynamic diagram. I also implemented 3D-plots into GeoGebra (which is only a 2D-tool). I use it frequently as for instance here. Thanks for you kind words! – String Aug 26 '14 at 07:14

2 Answers2

8

By the kernel decomposition theorem, you have ${\mathbb R}^3={\sf Ker}(A(A-I))={\sf Ker}(A)\oplus{\sf Ker}(A-I)$, so that ${\sf rank}(A)+{\sf rank}(A-I)=3$. If one of ${\sf rank}(A)$ or ${\sf rank}(A-I)$ is zero, we have the trivial cases $A=0$ or $A=I$. Otherwise, one of ${\sf rank}(A)$ or ${\sf rank}(A-I)$ is $1$, and the other is $2$. Remember also that when $A$ is idempotent, ${\sf rank}(A)$ coincides with ${\sf trace}(A)$.

Technical remark. A $3\times 3$ matrix has rank $1$ iff it has one of the three forms $[C,xC,yC],[0,C,xC],[0,0,C]$ where $x$ and $y$ are constants and $C$ is a column with at least one nonzero entry.

When ${\sf rank}(A)=1$, using the technical remark and reinjecting into $A\times A=A$, we see that $A$ is of one of the following three forms :

$$ \begin{array}{lcl} A_1&=&\left(\begin{array}{ccc} 1-xa_2-ya_3 & x(1-xa_2-ya_3) & y(1-xa_2-ya_3) \\ a_2 & xa_2 & ya_2 \\ a_3 & xa_3 & ya_3 \\ \end{array}\right), \\ A_2&=&\left(\begin{array}{ccc} 0 & a_1 & xa_1 \\ 0 & 1-xa_3 & x(1-xa_3) \\ 0 & a_3 & xa_3 \\ \end{array}\right), A_3=\left(\begin{array}{ccc} 0 & 0 & a \\ 0 & 0 & b \\ 0 & 0 & 1 \\ \end{array}\right) \\ \end{array} $$

Similarly, when ${\sf rank}(A-I)=1$, using the technical remark and reinjecting into $A\times A=A$, we see that $A$ is of one of the following forms :

$$ \begin{array}{lcl} A_4&=&\left(\begin{array}{ccc} -xa_2-ya_3 & x(-1-xa_2-ya_3) & y(-1-xa_2-ya_3) \\ a_2 & 1+xa_2 & ya_2 \\ a_3 & xa_3 & 1+ya_3 \\ \end{array}\right), \\ A_5&=&\left(\begin{array}{ccc} 1 & a_1 & xa_1 \\ 0 & -xa_3 & x(-1-xa_3) \\ 0 & a_3 & 1+xa_3 \\ \end{array}\right), A_6=\left(\begin{array}{ccc} 1 & 0 & a \\ 0 & 1 & b \\ 0 & 0 & 0 \\ \end{array}\right) \\ \end{array} $$

All the $A_i$ are idempotent. We have thus obtained a necessary and sufficient condition, made up of six cases (eight if you include the degenerate cases $A=0$ and $A=I$).

Ewan Delanoy
  • 63,436
  • This is such an impressive answer! Thank you for the delightful analysis! – String Aug 28 '14 at 08:27
  • @String Note that we do not need the whole of $A\times A=A$ when reinjecting and fixing the forms. In fact, only the condition on the trace is needed. – Ewan Delanoy Aug 28 '14 at 08:59
3

This is a partial answer, but something that you may find useful. Let $A$ be a $3\times3$ matrix and denote $t=\text{tr}(A)$, $d=\det(A)$ and $a=a_1+a_2+a_3$, where $a_k=\det(A_{\hat k\hat k})$ is the subdeterminant corresponding to the $k$th diagonal element of $A$. The characteristic polynomial of $A$ is $$ p(x) = \det(A-xI) = -x^3+tx^2-ax+d. $$ By the Cayley-Hamilton theorem $p(A)=0$, when the polynomial is naturally interpreted for matrices. That is, $$ -A^3+tA^2-aA+dI=0. $$ We can factor this polynomial: $$ -(A^2-A)(A-(t-1))+(t-a-1)A+dI=0. $$ Suppose that $A$ is idempotent: $A^2=A$. The above equation gives now $(t-a-1)A+dI=0$. If $t-a-1\neq0$, this means that $A$ is a multiple of the identity. It is easy to see that the only such solutions are $A=I$ and $A=0$ (and these are of course idempotent matrices).

All other idempotent matrices must therefore satisfy $t-a-1=0$ and $d=0$. That is, $\det(A)=0$ and $$ \text{tr}(A) = 1+\det(A_{\hat1\hat1})+\det(A_{\hat2\hat2})+\det(A_{\hat3\hat3}). $$ The second condition can be alternatively expressed as $\text{tr}(A)=1+\text{tr}(\text{cof}(A))$, where $\text{cof}(A)$ is the cofactor matrix of $A$. Trying to find explicit solutions to these equations seems messy.

Let me stress that these conditions are necessary for all idempotent matrices other than $0$ and $I$, but not sufficient. The characteristic polynomial does not retain all information about the original matrix. The following matrix satisfies both of my conditions but is not idempotent: $$ \begin{pmatrix} 1&0&0\\ 0&0&1\\ 0&0&0 \end{pmatrix}. $$


As a remark, the same approach works better for a $2\times2$ matrix $A$. Now $p(x)=x^2-tx+d$, so $A^2-tA+dI=0$. Using $A^2=A$ gives $(1-t)A+dI=0$. Again, either $A$ is a multiple of the identity (these two cases we know), or $1-t=0$ and $d=0$.

The equations are much easier so solve now. Suppose $ A = \begin{pmatrix} a&b\\ c&d \end{pmatrix}. $ We have $ad-bc=0$ and $a+d=1$. If $c=0$, we get $a\in\{0,1\}$ and $d=1-a$, and $b$ can be anything. If $c\neq0$, we get $a=1-d$ and $b=(d-d^2)/c$, and $d$ can be anything. It is easy to check which of these solutions are actually idempotent.

  • Clever work there to make the necessary (but not sufficient) condition $t-a-1=0$ "pop out"! It makes sense. I think that a complete analysis of $3\times3$ idempotents will have to be divided into several cases, and till now I have no idea how many parameters will be needed to describe each case. With $2\times2$ the problem happened to be simple enough since four entries $a,b,c,d$ could be cut down to two parameters $b,c$ describing the whole thing. But with nine entries it may be very messy, indeed! – String Aug 26 '14 at 07:36
  • 1
    @String, thanks. I'm not sure if anything neater could be said about the $3\times3$ idempotents. One can also derive a similar condition for larger idempotent matrices, but the resulting condition is even messier (and even farther away from being sufficient). Out of curiosity, I wrote a general $3\times3$ matrix to Mathematica and asked it to solve the coefficients from the idempotency equation. It could be solved, but let me just say that there were several cases... I did not want to reproduce that mess here. – Joonas Ilmavirta Aug 26 '14 at 09:14