# Matrix Algebra Operations

In this chapter, we will discuss the elementary operations of addition, subtraction, multiplication, and inversion, a matrix algebra analogue of division of scalar numbers. Subsequently, we will turn our attention to powers of matrices and to operations involving scalar numbers and matrices, scalar numbers and vectors, and vectors and matrices. The operations on matrices differ from similar operations of scalar algebra in several respects. The matrix algebra operations, in general, are not commutative and attention must be paid to whether the matrices are conformable with respect to the intended operation. Also, it must be noted whether the matrix operation pertains to matrix elements or to matrices.

Addition and Subtraction of Matrix Elements
Addition of Matrix Elements To add elements of matrices A and B and store the result as a matrix C,

elements of matrix A are added to their corresponding elements in matrix B and stored as elements of matrix C. Obviously, all three matrices must be of the same order or size. Notice that the plus sign in the above equation is enclosed in parentheses to indicate addition of matrix elements, as contrasted with addition of matrices, to be discussed in section to follow. An example of addition of matrix elements is schematized below

and illustrated as

1

information. not elements of vectors. and subtrahends.J. S. & Ceuvorst.J. minuends. D. of matrices. 46. 515-527. on close scrutiny. Addition and Subtraction of Matrices Textbooks on matrix algebra. However. & Wilkinson. 179-183. not elements of matrices) can be used for concise expression of several key algorithms of statistical theory and theory of probability. Matrices upon which an operation is permissible are said to conform to the operation. (1979) Dominance.. Applied Psychological Measurement. W. Krus. the above matrix elements can be added and subtracted if and only if the matrices are of the same order (identical in the number of rows and columns).Subtraction of Matrix Elements The operation of subtracting matrix elements can be schematized as and illustrated as In sum. and hierarchical scaling of variance space. The novel matrix algebra operations were first formulated in the following two articles: Krus. These operations are easy to imagine and are not discussed because most of their potential applications can be as well accomplished by unit vectors multiplications..M. Educational and Psychological Measurement. routinely describing major and minor vector products. do not suggest analogical operations for the major and minor sums and differences of summands. D. (1986) Matrix differencing as a concise expression of variance. R. 3. 2 . matrix algebra operations of addition and subtraction (of vectors.

The resulting matrix C will have the number of rows of the first matrix and the number of columns of the second matrix. The schematic representation of matrix addition is illustrated as Subtraction of Matrices To subtract two matrices A and B and store the results in matrix C again. For example. the matrices must be conformable to matrix addition. the number of columns in matrix A must equal the number of rows in matrix B. if matrix A is a 3x2 matrix and matrix B is a 2x3 matrix. The schematic representation of matrix subtraction is shown below 3 . the resulting matrix will be a 3x3 matrix. in another words. the matrices must be conformable. The resulting matrix C will have the number of rows of the first matrix and the number of columns of the second matrix.Addition of Matrices To add two matrices A and B and store the results in matrix C. The number of columns in matrix A must equal the number of rows in matrix B.

Multiplication of Matrix Elements To multiply elements of two matrices A and B and store the results in matrix C each element of matrix A is multiplied with its corresponding element in matrix B and the result is stored in matrix C. The schematic representation of multiplication of matrix elements is illustrated by a special case of multiplication of a matrix by a scalar number as in the special case of multiplication of a matrix by a constant it is customary to omit the (. 4 .) sign. the resulting matrix is a 2x2 matrix.illustrated as Note that the first matrix is a 2x3 matrix and the second matrix is a 3x2 matrix. both matrices have to be either of the same size. To perform this operation. or one matrix has to be a scalar matrix.

The number of columns in matrix A must equal the number of rows in matrix B. The schematic representation of matrix multiplication is illustrated as The postmultiplicatin of matrix B by matrix A using the same numerical example. Also. this operation is not commutative. to premultiply matrix B by matrix A the matrices must be conformable to matrix multiplication. and.Multiplication of Matrices The matrix multiplication is analogous to matrix addition. as the matrix addition. The product matrix C will have the number of rows of the first matrix and the number of columns of the second matrix. is illustrated as Premultiplication of a matrix A by a diagonal matrix T 5 . unless both matrices are symmetric.

In schematic representation The following example illustrates rearrangement of the columns of a matrix Division of Matrix Elements To divide elements of two matrices A and B and store the results in matrix C corresponding elements of A and B matrices form a fraction. using as an example a division of a matrix by a scalar number Inverse 6 . All three matrices must be of the same size. The division sign is enclosed in parentheses to indicate division of matrix elements. stored in C.is equivalent to scalar multiplication of each row element in the matrix by the same row element of the diagonal matrix. An example of division of matrix elements is schematized below and illustrated. or the divisor must be a scalar number.

To invert a matrix. called singular matrices. The inverse of a matrix is denoted by a -1 superscript. For the special case of the two-by-two matrices. and by dividing all elements by the determinant. Only square matrices can be inverted. we must determine that the matrix is invertible by computing its determinant. some square matrices. This is analogous to the restriction on the division of scalar numbers that cannot be divided by a zero. Consider a matrix A 7 . The reciprocal of a matrix is called its inverse. first. the matrix is invertible. changing signs of the off-diagonal elements.The analog of matrix division is multiplication by a reciprocal. Consider a special case of a two by two matrix A with determinant equal to ad-bc. do not have inverses. the inverse of the above matrix can be calculated by switching elements in the principal diagonal. If the determinant is not a zero. however.

the only number without a reciprocal is 0. It means that the matrix is invertible. In arithmetic. change signs of the off-diagonal elements. Thus.. we must determine whether this matrix is invertible. do not have an inverse. The determinant is computed as (1) (4)-(2)(3) and equals -2. i. In matrix algebra. the singular matrices. This determinant does not equal zero.First. switch elements in the principal diagonal. the matrix inverse equals Analogous to scalar multiplication of a number by its reciprocal an identity matrix I equals this analogy also suggests the nature of matrix singularity.e. matrices with a zero determinant. To invert a matrix. A numerical illustration of the above equation is 8 .

best done with the help of a computer. The inverse of a matrix larger than a two-by-two matrix is difficult. Powers of Matrix Elements The squares of the matrix elements are written as In schematic representation A numerical example is A matrix to a fractional power to a fractional negative power provides for obtaining roots of matrix elements and a matrix for obtaining reciprocals of roots of matrix elements.The discussed procedures for matrix inversion apply only to two-by-two matrices. Powers of Matrices The square of a matrix is a multiplication of a matrix by itself In schematic representation 9 .

this operation is illustrated as the results of the illustrative example can be compared with the previous results to stress that a power of a matrix is not equal to power of matrix elements . 10 .