Design matrix

A design matrix is a matrix that is used in the certain statistical models, e.g., the general linear model. It can contain indicator variables (ones and zeros) that indicates group membership in an ANOVA and it represents the independent variables. The advantage with a design matrix is that it is able to represent a number of different experimental designs and statistical models, e.g., ANOVA, ANCOVA, and linear regression

Example

One-way ANOVA

Example with a one-way ANOVA with 3 groups and 7 observations. The first column in the design matrix models the grand mean of the ys, while the 3 remaining columns indicate the group membership of each observation. Here the first group consists of the 3 first observations and the next two groups each consist of two observations. ${\begin{bmatrix}y_{1}\\y_{2}\\y_{3}\\y_{4}\\y_{5}\\y_{6}\\y_{7}\end{bmatrix}}={\begin{bmatrix}1&1&0&0\\1&1&0&0\\1&1&0&0\\1&0&1&0\\1&0&1&0\\1&0&0&1\\1&0&0&1\end{bmatrix}}{\begin{bmatrix}\mu \\\tau _{1}\\\tau _{2}\\\tau _{3}\end{bmatrix}}+{\begin{bmatrix}u_{1}\\u_{2}\\u_{3}\\u_{4}\\u_{5}\\u_{6}\\u_{7}\end{bmatrix}}$