Why it matters

ToT enables search-based reasoning. Understanding shapes advanced.

Advertisement

The architecture

Generate multiple next-step candidates.

Evaluate each.

Expand promising; prune others.

BFS or DFS traversal.

Tree of ThoughtsMultiple candidatesper stepEvaluatescore eachExpand bestsearch treeCombines LLM generation with search algorithms (BFS/DFS/BFS-with-eval)
ToT.
Advertisement

How it works end to end

Yao et al. 2023.

Applications: Game of 24, Creative Writing.

Cost proportional to tree size.

Value function critical.