Dr. Sheng Shen
AI Research Scientist
Verified Proof of Work Artifacts
2 items catalogedEach artifact below represents an authenticated research publication, production code repository, or technical architectural framework directly authored or co-created by Dr. Sheng Shen. Every entry undergoes editorial source verification.
Efficient Memory Management for Structured Generation in Large Language Models
Formulated algorithms for structured JSON and regex-constrained LLM generation that maintain jump-forward finite-state machines without re-allocating KV caches, accelerating structured extraction by 3x.
Complex nested recursive schemas require state graph compilation before first token generation.
HuggingGPT: Solving AI Tasks with ChatGPT and its Friends in Hugging Face
Developed HuggingGPT (JARVIS), a pioneering multi-agent framework that uses an LLM controller to parse user intent, plan task dependency graphs, dispatch subtasks to Hugging Face expert models, and synthesize results.
Multi-hop tool routing introduces latency cascades if intermediate domain models fail or return incompatible schemas.