Ten skills drawn from Andrej Karpathy's essays, talks and code, with every quote checked against the original source.
01 Training neural nets that actually work
A six-step routine for training a model reliably, with a check at every step so a broken pipeline gets caught in minutes instead of after a wasted week.
▸ It gives concrete tests that expose silent failures most people never notice.
02 Knowing your data cold
Before any model code, spend real time reading the actual examples, hunting for duplicates, mislabels and leaks. In modern AI, the data is the program.
▸ The problems that wreck a model hide in the aggregates a dashboard shows; only reading the examples reveals them.
03 Products that improve themselves
A live AI product gets better through a loop, not a launch: ship it, collect where it fails, fix those cases, and repeat.
▸ The aim is to automate the loop so well the product keeps improving while the team is on holiday.
04 Race a single number
Pick the one number that matters, freeze everything else, and race to improve it. Vague engineering becomes a sport with a scoreboard.
▸ One number makes progress impossible to argue with; composite scores just hide the trade-offs.
05 Small, readable, forkable code
Write code for the person who will read and change it, not for a hypothetical user who will configure it. Fewer options, sensible defaults, less to wade through.
▸ Every config flag is a promise to support a combination you will never test.
06 Learn it by building it
Understand something important, like how AI attention or back-propagation works, by building the smallest version of it from an empty file.
▸ You only really debug what you could have built yourself. Building it gives you X-ray vision into the real tools.
07 Real learning over highlight reels
Skip the ten-minute explainer videos and do the harder reading. Learn on demand through real projects, and teach what you learn to find the gaps.
▸ Effort is the signal. Most things sold as learning are entertainment in disguise.
08 AI products with a human in the loop
Design AI features as a tight loop where the model proposes and the person approves, with a dial so users give it more rope as trust grows.
▸ A giant AI change does not speed a person up, it makes them the bottleneck. Small, reviewable steps keep them fast.
09 Knowing how much to trust the AI
A simple rule for building with AI by the stakes: free-flow for throwaways, AI-with-review for standard work, hand-written for the genuinely novel.
▸ AI is brilliant on well-trodden ground and shaky on the new. Matching the mode to the task is the whole skill.
10 Choosing what is worth doing
How to choose work that matters: a problem ten times as important is rarely ten times as hard, so aim higher, then protect the focus to actually finish it.
▸ Work nobody hears about rounds to zero, so the write-up and the demo are half the project.