Lianmin Zheng
Co-Founder & AI Systems Researcher
Verified Proof of Work Artifacts
2 items catalogedEach artifact below represents an authenticated research publication, production code repository, or technical architectural framework directly authored or co-created by Lianmin Zheng. Every entry undergoes editorial source verification.
SGLang: Fast Serving Framework for Complex Language Model Programs
Engineered SGLang featuring RadixAttention, which maintains a radix tree over KV caches to enable automatic multi-turn and prefix cache reuse, delivering up to 5x higher throughput for complex multi-call LLM workflows.
Radix tree traversal introduces slight metadata lookup overhead for workloads with completely random, unshared prefixes.
Judging LLM-as-a-Judge with MT-Bench and Chatbot Arena
Co-authored the landmark NeurIPS 2023 paper establishing crowd-sourced, blind pairwise human evaluation (Chatbot Arena) and LLM-as-a-judge benchmarks, standardizing empirical foundation model comparison globally.
Susceptible to verbosity and style bias when using automated LLM evaluators without strict length-penalized rubrics.