Incremental learning

Incremental learning

Suppose we have a sequence of learning rates . Then a value incrementally learns some random variable if for with samples from we set then let . This is denoted .