The term least squares is something most have heard of at one point or another. It is arguably one of the most fundamental concepts in areas such as regression modeling and machine learning. The familiarity of the term least squares can also lead to perhaps the false assumption of having a good foundational understanding. This article will present the mathematics of least squares independent of any application such as linear regression (this will be covered in another article).

Mathematics of Least Squares