Autoresearch · Link to this talk
An introduction to autoresearch as a way of turning a coding agent into a constrained experimentation system. Drawing on Andrej Karpathy's project, the talk explains how to limit what the agent can modify, evaluate each attempt with fixed metrics, and retain the best results reproducibly, as well as the risks of optimising a metric that does not represent the real objective.
Coding agents · Automated experimentation · Evaluation · Reproducibility · Python
Materials pending publication.