Chip Huyen

Author, Designing Machine Learning Systems | AI Engineer & Systems Educator

Sources checked
ABOUT

Chip Huyen is a computer scientist, author, and educator whose work on machine learning systems engineering is taught at Stanford and used by engineering teams globally. Her book 'Designing Machine Learning Systems' is an industry standard for production ML, and her technical writing provides actionable blueprints for production LLM engineering.

Areas of focus

Professional niches

THE WORK BEHIND THE PROFILE

Proof of Work

explanationChecked Sep 20, 2026

Evaluation Patterns for LLM Systems in Production

A definitive technical analysis by Chip Huyen breaking down model-graded evals, reference-based vs. reference-free metrics, human evaluation calibration, and online production monitoring loops.

Scope & limitations

LLM-as-a-judge approaches have inherent biases (length bias, self-enhancement bias) requiring continuous calibration against human golden datasets.

Context: Covers evaluation architectures for RAG, summarization, and agentic workflows.

View mission
explanationChecked Sep 20, 2026

Building LLM-Based Systems: Latency, Cost, and Architecture Trade-offs

Comprehensive guide detailing the engineering differences between training, fine-tuning, and prompt-based RAG architectures in enterprise production.

Scope & limitations

System design blueprint; implementation performance depends on team infrastructure and latency budgets.

Context: LLM systems engineering, inference caching, and evaluation harnesses.

View mission

Guides to evaluating AI expertise