Verifiers

Sometimes evaluation is easier than generation

It’s often easier to tell whether a solution is correct than to come up with it. We can use this to improve the quality of responses. As a first step, let’s use it to check the quality of responses. We’ll try two versions:

Just ask the model:
Given a list of reasoning steps, ask the model:

PreviousRecursive amplification NextChecking answers

Last updated 2 years ago

It’s often easier to tell whether a solution is correct than to come up with it. We can use this to improve the quality of responses. As a first step, let’s use it to check the quality of responses. We’ll try two versions:

Just ask the model:
Given a list of reasoning steps, ask the model:

Is this solution correct?

For each step, is it correct?