Ilya Sutskever
Co-Founder, Safe Superintelligence Inc. (SSI) | Former Chief Scientist & Co-Founder, OpenAI
Co-founder of Safe Superintelligence Inc. (SSI) and former Chief Scientist and co-founder of OpenAI. One of the most cited computer scientists in history with over 500,000 citations. Co-inventor of AlexNet (which launched modern deep learning in 2012), Sequence to Sequence learning with neural networks (precursor to modern attention and translation models), and chief architect behind GPT-1, GPT-2, GPT-3, GPT-4, and the Superalignment initiative.
Areas of focus
Professional niches
Proof of Work
Improving Language Understanding by Generative Pre-Training (GPT-1)
Co-architected the foundational framework establishing that unsupervised autoregressive pre-training on diverse text corpora, followed by discriminative task fine-tuning, produces superior transfer learning across reasoning, classification, and natural language inference benchmarks.
Fine-tuning still required bespoke task heads prior to the zero-shot prompting breakthrough of GPT-2 and GPT-3.
Context: 12-layer decoder-only transformer with masked self-attention heads trained on BooksCorpus.
View missionSequence to Sequence Learning with Neural Networks
Pioneered the multi-layered Long Short-Term Memory (LSTM) encoder-decoder architecture mapping arbitrary sequence lengths to variable output sequences. Revolutionized machine translation, conversational AI, and established the direct conceptual architecture upon which transformers and autoregressive LLMs were built.
Recurrent execution bottlenecked parallelization across large cluster topologies before self-attention mechanisms emerged.
Context: Deep LSTM networks, WMT14 English-to-French benchmark, 160,000 input vocabulary.
View mission