Andrej Karpathy

Founder, Eureka Labs | Former Director of AI at Tesla & OpenAI Founding Member

Sources checked
ABOUT

Andrej Karpathy is an AI researcher and educator who founded Eureka Labs, an AI-native education company. Previously, Andrej served as the Director of AI at Tesla, leading the Autopilot computer vision and neural network architecture teams, and was a founding research scientist at OpenAI. Widely revered as one of the world's premier deep learning educators, he created nanoGPT and the landmark 'Neural Networks: Zero to Hero' lecture series.

Areas of focus

Professional niches

THE WORK BEHIND THE PROFILE

Proof of Work

Add work ↗
implementationChecked Sep 20, 2026

nanoGPT: Minimal, Readable, and Fast PyTorch Framework for Training Medium GPTs

A pure, clean, and hackable 300-line PyTorch implementation for training, fine-tuning, and evaluating transformer language models with support for FlashAttention and torch.compile.

Scope & limitations

Engineered for educational transparency and small-to-medium parameter models; multi-node distributed trillion-token training requires complex pipeline parallel frameworks like Megatron.

Context: PyTorch 2.0, CUDA, Python, FlashAttention, and OpenWebText.

View mission

Guides to evaluating AI expertise