Alexandr Wang
Founder & CEO, Scale AI | Pioneer of Frontier Data Engines & SEAL Evaluations
Founder and CEO of Scale AI, the data infrastructure bedrock supporting frontier model developers including OpenAI, Meta, Google, Microsoft, and the US Department of Defense. Started Scale AI at age 19 after studying at MIT. Creator of the SEAL Leaderboards (Safety, Evaluations, and Alignment Lab), establishing rigorous third-party private benchmark methodologies for coding, reasoning, and adversarial red teaming.
Areas of focus
Professional niches
Proof of Work
Scale AI Data Engine for Supervised Fine-Tuning & RLHF at Scale
Engineered human-in-the-loop expert annotation pipelines generating multi-million token pairs of complex instruction following, code review, and preference datasets powering the training of leading open and commercial models.
Human expert verification costs scale super-linearly with problem complexity in post-doctoral mathematics and legal reasoning.
Context: Distributed annotation platforms with automated inter-annotator agreement metrics and synthetic validation loops.
View missionSEAL Leaderboards: Standardized Private Evals for Frontier LLM Benchmarking
Created the SEAL evaluation platform providing contamination-free, expert-curated benchmark suites testing advanced programming (Coding-GSM), mathematical rigor, and adversarial safety to combat public leaderboard gaming.
Requires ongoing prompt refresh cycles to prevent indirect test data leakage into web-crawled pretraining corpora.
Context: Private held-out dynamic evaluation testbeds continuously updated by human domain experts.
View mission