AI code generation

Abstract representation of large language models and AI technology, symbolizing training with gradient descent.

Gradient Descent Learned to Code

Karpathy’s 2017 joke became a benchmark result. On test-verifiable coding tasks, models now solve what looked impossible; the bottleneck moved to verification.

November 5, 2026 6 min read