Objective function
An objective function
is simply a method to assess how “well” some function is doing. The evaluation space should ideally be totally ordered. For example in the modelling framework given some testing data
the objective function could be Mean squared error (MSE) where . Then will be some score of candidate . However, they can be much more generic or even less deterministic than this.