Andrej Karpathy

A sleek modern robot toy standing against a colorful gradient backdrop, offering ample copy space.

Gradient Descent Learned to Code

Karpathy’s 2017 joke became a benchmark result. On test-verifiable coding tasks, models now solve what looked impossible; the bottleneck moved to verification.

November 5, 2026 6 min read