Decomposition of reasoning tasks
We’ll call programs that describe how to break down a task recipes.
- Process-based systems are built on human-understandable task decompositions, with direct supervision of reasoning steps.
- Outcome-based systems are built on end-to-end optimization, with supervision of final results.
Factored cognition is a prerequisite for making the reasoning processes of large language models explicit so that they can be supervised more easily.