Why it matters

UCT is default MCTS policy. Understanding shapes MCTS tuning.

Advertisement

The architecture

Score = mean value + c * sqrt(ln N / n).

N: parent visits, n: child visits.

UCT formulaExploit termmean valueExplore termsqrt(ln N / n)UCT totalsum weighted by cConstant c tunes exploration; sqrt(2) common; PUCT (AlphaGo) adds prior
UCT.
Advertisement

How it works end to end

Auer 2002 + Kocsis + Szepesvari 2006.

c: exploration constant.

PUCT: adds prior term for AlphaGo.