Hamel Husain
Founder, Parlance Labs | AI Evaluation Architect & LLM Systems Consultant
Sources checkedHamel Husain is an AI consultant and founder of Parlance Labs. Previously a Staff Machine Learning Engineer at GitHub, Airbnb, and DataRobot, Hamel teaches engineers how to build, evaluate, and fine-tune production LLM systems. His guides on evaluation-driven development and domain-specific fine-tuning are widely used across top AI startups.
Areas of focus
Professional niches
Proof of Work
Your AI Product Needs Evals: Comprehensive Guide to Unit Testing & LLM Evaluation
Comprehensive framework for creating automated evaluation loops, synthetically augmented test sets, and LLM-as-a-judge scoring harnesses that measure production degradation before deployment.
LLM-as-a-judge evaluators can exhibit self-preference bias and positional bias if uncalibrated against human baseline judgments.
Context: Promptfoo, Braintrust, Python, OpenAI, Anthropic, and OpenPipe.
View mission