Value function (RL)

A value function is a mapping of states to a long term worth for a actor in a Markov decision process. This is defined by .

Given you are acting along policy we can calculate the ideal value function to be