Dr. Matei Zaharia
Chief Technologist
Verified Proof of Work Artifacts
2 items catalogedEach artifact below represents an authenticated research publication, production code repository, or technical architectural framework directly authored or co-created by Dr. Matei Zaharia. Every entry undergoes editorial source verification.
DSPy: Compiling Declarative Language Model Calls into State-of-the-Art Pipelines
Co-created DSPy, a programming framework that abstracts brittle prompt engineering into typed declarative modules (Predict, ChainOfThought, ProgramOfThought) and uses optimizers (BootstrapFewShot, MIPRO) to compile optimal few-shot prompts and weight updates automatically.
Compiling complex multi-step pipelines requires running multiple optimization iterations, incurring upfront LLM invocation tokens during the optimization phase.
MLflow: A Machine Learning Lifecycle and Foundation Model Evaluation Platform
Created MLflow, an open-source platform managing the end-to-end machine learning lifecycle, including experiment tracking, model registry, artifact packaging, and evaluation metrics for classical ML and modern LLM pipelines.
Self-hosted deployments require configuring and maintaining persistent artifact object storage (S3/GCS) and relational backend metadata databases.