
holy f*cking sh*t Karpathy put an entire AI degree on github for free while you are still paying $200/month to watch youtube tutorials from a guy with 3000 followers
7 repos. 306,741 stars combined. in the right order they take you from "how a neuron learns" to "agents that run research overnight while you sleep"
every repo you skip is a layer of understanding your competition at work already has and you do not. and every month you keep "planning to start" is another month someone on your team gets handed the AI project you should have been running
here is the exact order. do not reshuffle it
1. micrograd →
how a neural net actually learns. backpropagation in about 100 lines of python. this is where every AI engineer on earth started. if you cannot read this file, every other repo on the list is going to feel like black magic to you
2. nn-zero-to-hero →
his full video course. lecture notebooks that walk you from a single neuron to GPT. the thing people pay $2000 for from AI "bootcamps" that teach a fraction of what is in this one free repo
3. minbpe →
how text actually turns into tokens. the tokenizer that sits inside every LLM, in clean minimal code. this is the part 95% of self-taught people skip, and it is why their models never work right
4. nanoGPT →
your own GPT. the simplest repo in existence to train and fine-tune one. after this file you stop asking "how does ChatGPT work" because you have literally built the smaller version with your own hands
5. llm.c →
the same training with nothing hidden. raw C and CUDA, no PyTorch wrapper doing the hard parts for you. this is where you stop being a prompt engineer and start being an actual engineer
6. nanochat →
a full chat model end to end. GPT-2 level training that cost ~$43,000 in 2019. in this repo it costs about $48. let that sit for a second. the thing people called a breakthrough is now a weekend project
7. autoresearch →
agents that do the research for you. the agent edits your training code, trains for 5 minutes, keeps whatever improved, discards whatever did not, and repeats all night while you sleep. this is where the people reading this list stop being students and start being whatever comes after that
the brutal truth most people avoid: train one GPT from scratch and you become the person who gets handed the AI project at work, along with the raise that comes with it. keep "planning to start" and you become the person watching that happen to someone else
the classroom half of the same degree, what Stanford actually teaches about AI for real, is below
yurshev @yurshevv