Partial inverse of a matrix

This article is about the partial inverse of a matrix. For the partial inverse of a functions, see Inverse_function § Partial_inverses.

In linear algebra and statistics, the partial inverse of a matrix is an operation related to Gaussian elimination which has applications in numerical analysis and statistics. It is also known by various authors as the principal pivot transform, or as the sweep, gyration, or exchange operator.

Given an $n\times n$ matrix $A$ over a vector space $V$ partitoned into blocks:

${\begin{aligned}A={\begin{pmatrix}A_{11}&A_{21}\\A_{12}&A_{22}\end{pmatrix}}\end{aligned}}$

If $A_{11}$ is invertible, then the partial inverse of $A$ around the pivot block $A_{11}$ is created by inverting $A_{11}$, putting the Schur complement $A/A_{11}$ in place of $A_{22}$, and adjusting the off-diagonal elements accordingly:

${\begin{aligned}{\text{inv}}_{1}A={\begin{pmatrix}(A_{11})^{-1}&-(A_{11})^{-1}A_{21}\\A_{12}(A_{11})^{-1}&A_{22}-A_{21}(A_{11})^{-1}A_{12}\end{pmatrix}}\end{aligned}}$

As defined this way, this operator is its own inverse: ${\text{inv}}_{k}({\text{inv}}_{k}(A))=A$, and if the pivot block $A_{11}$ is chosen to be the entire matrix, then the transform simply gives the matrix inverse $A^{-1}$. Note that some authors define a related operation (under one of the other names) which is not an inverse per se; particularly, one common definition instead has $({\text{inv}}_{k}^{2}(A)=-A$.

Conceptually, partial inversion corresponds to a rotation of the graph of the matrix $(X,AX)\in V\times V$, such that, for conformally-partitioned column matrices $(x_{1},x_{2})^{T}$ and $(y_{1},y_{2})^{T}$:

${\begin{aligned}A{\begin{pmatrix}x_{1}\\x_{2}\end{pmatrix}}={\begin{pmatrix}y_{1}\\y_{2}\end{pmatrix}}\Leftrightarrow {\text{inv}}_{1}(A){\begin{pmatrix}y_{1}\\x_{2}\end{pmatrix}}={\begin{pmatrix}x_{1}\\y_{2}\end{pmatrix}}\end{aligned}}$

The transform is often presented as a pivot around a single non-zero element $a_{kk}$, in which case one has

${\begin{aligned}\left[{\text{inv}}_{k}(A)\right]_{ij}={\begin{cases}{\frac {1}{a_{kk}}}&i=j=k\\-{\frac {a_{kj}}{a_{kk}}}&i=k,j\neq k\\{\frac {a_{jk}}{a_{kk}}}&i\neq k,j=k\\a_{ij}-{\frac {a_{ik}a_{kj}}{a_{kk}}}&i\neq k,j\neq k\end{cases}}\end{aligned}}$

Partial inverses obey a number of nice properties:

• inverting around different blocks commute, so larger pivots may be built up from sequences of smaller ones
• partial inversion preserves the space of symmetric matrices

Use of the partial inverse in numerical analysis is due to the fact that there is some flexibility in the choices of pivots, allowing for non-invertible elements to be avoided, and because the operation of rotation (of the graph of the pivoted matrix) has better numerical stability than the shearing operation which is implicitly performed by Gaussian elimination. Use in statistics is due to the fact that the resulting matrix nicely decomposes into blocks which have useful meanings in the context of linear regression.