PUBLISHED AI RESEARCH AND PROJECTS

AI research and projects

The research, projects, and explanations behind the people. Read the source, inspect verified code and models, and find a collaborator.

Clear all filters

A source check confirms that a source supports the summary. It is not an independent replication or endorsement. Our methodology ↗

Showing 241–241 of 241 proofs of work · Kind: implementation · Newest first
Page 16 of 16
implementationChecked Sep 20, 2026

nanoGPT: Minimal, Readable, and Fast PyTorch Framework for Training Medium GPTs

Andrej Karpathy · Eureka Labs / ex-Tesla, OpenAI

A pure, clean, and hackable 300-line PyTorch implementation for training, fine-tuning, and evaluating transformer language models with support for FlashAttention and torch.compile.

Scope & limitations

Engineered for educational transparency and small-to-medium parameter models; multi-node distributed trillion-token training requires complex pipeline parallel frameworks like Megatron.

Context: PyTorch 2.0, CUDA, Python, FlashAttention, and OpenWebText.

View mission
Showing 241–241 of 241 proofs of work