Andrej Karpathy on the No Priors podcast talking about agents, AutoResearch, and what he calls the “loopy era” of AI.
Two things stood out. First, the Frontier Lab vs. Outside framing — frontier labs have massive trusted compute, but the Earth has far more untrusted compute. If you design the right verification systems (discover is expensive, verify is cheap), a distributed swarm of outside contributors could outpace closed labs. There’s something appealing about that asymmetry as a balancing force.
Second, AutoResearch — fully autonomous research loops where an agent edits training code, runs experiments, evaluates results, and commits improvements via Git. No human in the loop. In a 2-day run it executed ~700 experiments and found 20 real optimizations on a single GPU. The human role shifts to writing evaluation criteria and research prompts, not the code itself.