Dr. Percy Liang
Associate Professor, Stanford University | Director, Center for Research on Foundation Models
Dr. Percy Liang is an Associate Professor of Computer Science and Statistics at Stanford University and the Director of the Center for Research on Foundation Models (CRFM). His research spans natural language processing, foundation model evaluation, transparency, and statistical robustness. He is the lead organizer of HELM (Holistic Evaluation of Language Models).
Areas of focus
Professional niches
Proof of Work
Stanford CRFM Alpaca: A Strong, Replicable Instruction-Following Model
The landmark research project that demonstrated high-quality instruction tuning of open foundation models using self-instruct data synthesis at a compute cost under $600, catalyzing the open-source LLM revolution.
Trained on 52k synthetic instructions; subject to hallucination and inherits safety limitations of the underlying foundation model.
Context: Fine-tuned on LLaMA 7B using standard PyTorch FSDP on 8 80GB A100 GPUs.
View missionHolistic Evaluation of Language Models (HELM)
A multi-dimensional benchmark evaluating foundational LLMs across 42 real-world scenarios and 7 evaluation metrics to eliminate selective benchmark reporting.
Continuous maintenance required as frontier model providers iterate closed alignment weights.
Context: Empirical evaluation suite covering all major commercial and open foundation models.
View mission