Sholto Douglas & Trenton Bricken - How to Build & Understand GPT-7's Mind

Hayekian
Scale has emergent properties
Headcannon
Research - work backwards from problems (fix issues), ideas (lots, prune, shot call = ruthless prioritization), experiment, engineer, debug, interpret
Cycle time separate people - likely more than youd think shot calling does
Reasonning traces are valuable - drafts of docs, source code and pull reqs

Created: March 28 2024.
Modified: March 28 2024.