When a matrix cannot be inverted, how do you solve for the best fit?

The Four Fundamental Subspaces and Least Squares · 26:55 · Video: MIT OpenCourseWare · Watch at the source

In short: Linear algebra often relies on finding inverses, but what happens when a matrix is not invertible? This video explores the four fundamental subspaces and introduces the pseudoinverse as a powerful tool for finding the best possible solution in least squares problems.

The four fundamental subspaces consist of the column spaces and nullspaces of a matrix A and its transpose A^T. These subspaces exist in m-dimensional and n-dimensional spaces, providing a geometric framework for understanding linear systems. When m equals n and both nullspaces contain only the zero vector, the matrix is invertible.

However, when A is not invertible, the standard inverse A^-1 does not exist. In these cases, the goal shifts to finding a vector x within the row space that minimizes the distance || Ax - b || within the column space. This approach, known as least squares, utilizes the pseudoinverse to identify the optimal vector when a perfect solution is unreachable.

Opens the Intellect+ feed with this card first. Swipe up for the next one.

Sources

To cite this card, link to https://intellectplus.co.uk/app/ideas-the-four-fundamental-subspaces-and-least-squares.

How we source, check and correct cards: Editorial standards.

General information, not professional advice. Spotted an error? Flag the card or see corrections and complaints.

Intellect Plus is a visual educational discovery platform for exploring fascinating facts and ideas. Brain Food, Not Brain Rot. What is Intellect Plus?

Related

Finding something worth knowing…