Training Language Models to Follow Instructions with Human Feedback
Ouyang, Wu, Jiang, et al.
2022 NeurIPS 2022
TL;DR
The InstructGPT recipe — SFT on demonstrations, reward model on human preferences, PPO fine-tuning — turns a raw GPT into a model that follows instructions and refuses harmful requests.