Eugene Yan
Applied Scientist, Amazon | Enterprise RAG & Recommendation Architect
Verified Proof of Work Artifacts
2 items catalogedEach artifact below represents an authenticated research publication, production code repository, or technical architectural framework directly authored or co-created by Eugene Yan. Every entry undergoes editorial source verification.
Amazon: Scalable Model Serving Architecture & Latency Optimization
A production infrastructure blueprint developed by Eugene Yan at Amazon, implementing continuous batching, quantized weights, and horizontal autoscaling for high-concurrency model inference.
Deployment specifications are tailored to modern GPU cluster infrastructure; requires containerized execution runtimes.
Patterns for Building LLM-based Systems & Products
Comprehensive reference manual documenting production patterns for evaluation, guardrails, retrieval-augmented generation, and fine-tuning with cost/latency trade-offs.
System design patterns; individual implementations must be profiled for specific latency constraints.