Why it matters
Online learning shapes sequential decisions. Understanding shapes ML theory.
Advertisement
The architecture
Predict + observe loss + update.
Regret: total loss vs best fixed action.
Sublinear regret = learning.
Advertisement
How it works end to end
Regret analysis (worst case).
FTRL, mirror descent, Hedge.
Bandits: partial feedback.
OCO: online convex optimization.