Horace He
AI Compiler Architect
Verified Proof of Work Artifacts
2 items catalogedEach artifact below represents an authenticated research publication, production code repository, or technical architectural framework directly authored or co-created by Horace He. Every entry undergoes editorial source verification.
PyTorch 2: Dynamic Python Bytecode Compilation and TorchInductor
Co-authored the ACM ASPLOS 2024 paper detailing TorchDynamo and TorchInductor, which intercept Python frame evaluation bytecodes to capture computational graphs safely and generate fused Triton GPU kernels with 0% code modifications.
Dynamic control flow with non-tensor Python data structures forces graph breaks that require partial eager execution fallback.
Making Deep Learning Go Brrrr: Performance Engineering and GPU Kernel Optimization
Authored the definitive technical guide on GPU architecture, memory hierarchy, arithmetic intensity, and operator fusion, read by hundreds of thousands of AI infrastructure practitioners worldwide.
High-level theoretical roofline models do not account for tail-latency jitter from asynchronous PCIe bus transfers.