Ilya Sutskever
Co-Founder, Safe Superintelligence Inc. (SSI) | Former Chief Scientist & Co-Founder, OpenAI
Verified Proof of Work Artifacts
2 items catalogedEach artifact below represents an authenticated research publication, production code repository, or technical architectural framework directly authored or co-created by Ilya Sutskever. Every entry undergoes editorial source verification.
Improving Language Understanding by Generative Pre-Training (GPT-1)
Co-architected the foundational framework establishing that unsupervised autoregressive pre-training on diverse text corpora, followed by discriminative task fine-tuning, produces superior transfer learning across reasoning, classification, and natural language inference benchmarks.
Fine-tuning still required bespoke task heads prior to the zero-shot prompting breakthrough of GPT-2 and GPT-3.
Sequence to Sequence Learning with Neural Networks
Pioneered the multi-layered Long Short-Term Memory (LSTM) encoder-decoder architecture mapping arbitrary sequence lengths to variable output sequences. Revolutionized machine translation, conversational AI, and established the direct conceptual architecture upon which transformers and autoregressive LLMs were built.
Recurrent execution bottlenecked parallelization across large cluster topologies before self-attention mechanisms emerged.