True error
Suppose we are in the modelling framework with feature space
with some probability distribution on it, a hypothesis space and the true concept . For some candidate hypothesis the true error This is the integral of the indicator function on whether it is correct or not weighted with respect to .