Linear Algebra: Linear Algebra
Eigensystems
In linear algebra, eigensystems denote a set of problems that include finding eigenvectors and eigenvalues. The word eigen comes from German and means ‘own’, which will make sense when we formulate the problem more concretely. Informally, the main idea behind eigensystems is finding vectors that transform in a special way when we apply a certain transformation on them. Specifically, we wish to find which vectors are affected the least by the transformation , and by least we mean that they are not rotated, but are only scaled by a factor . Formally, given a vector and a transformation , this requirement can be written as:
The second option is that the system of linear equations is not indeed linearly independent. This implies that the columns of the matrix are linearly dependent, which in turn implies that the mapping is not bijective (does not have an inverse). As we have seen in the previous section, matrices that are not invertible have the determinant zero, and using this property, we can search for non-trivial solutions. Thus, we can start solving the problem by looking for values of that satisfy the following equation:
Summary In this theory page we have explored eigensystems, which involve finding eigenvectors and eigenvalues of a given matrix. Eigenvectors are vectors that remain in the same direction but can be rescaled when a transformation is applied. Eigenvectors and eigenvalues have many applications in mathematics, including matrix diagonalizations, Markov chains, and image compression.