Linear regression
Linear regression is the special case of polynomial regression where the degree of the polynomial is 1. Therefore we are restricted to the modelling paradigm of
where . Whilst the may seem more restrictive than polynomial regression with a mutation of the input space linear regression is just as flexible.