PUBLISHED AI RESEARCH AND PROJECTS
AI research and projects
The research, projects, and explanations behind the people. Read the source, inspect verified code and models, and find a collaborator.
A source check confirms that a source supports the summary. It is not an independent replication or endorsement. Our methodology ↗
implementationChecked Sep 20, 2026
nanoGPT: Minimal, Readable, and Fast PyTorch Framework for Training Medium GPTs
Andrej Karpathy · Eureka Labs / ex-Tesla, OpenAIA pure, clean, and hackable 300-line PyTorch implementation for training, fine-tuning, and evaluating transformer language models with support for FlashAttention and torch.compile.
Scope & limitations
Engineered for educational transparency and small-to-medium parameter models; multi-node distributed trillion-token training requires complex pipeline parallel frameworks like Megatron.
Context: PyTorch 2.0, CUDA, Python, FlashAttention, and OpenWebText.
View missionShowing 241–241 of 241 proofs of work