Clem Delangue
AI Founder
Verified Proof of Work Artifacts
2 items catalogedEach artifact below represents an authenticated research publication, production code repository, or technical architectural framework directly authored or co-created by Clem Delangue. Every entry undergoes editorial source verification.
The Open LLM Leaderboard: Standardized Evaluation for Open Foundation Models
Established the Open LLM Leaderboard utilizing the LM Evaluation Harness to provide transparent, reproducible, contamination-checked benchmarks (MMLU-Pro, GSM8k, IFEval, MuSR, MATH) across thousands of community LLMs.
Benchmarks face test set leakage risks over time; static multiple-choice formats do not fully evaluate conversational agency or multi-turn tool calling.
Hugging Face Transformers Platform & Open Weights Ecosystem
Co-created and scaled the Hugging Face platform, which provides standardized APIs and model abstractions for PyTorch, TensorFlow, and JAX across hundreds of thousands of state-of-the-art transformer checkpoints.
Coordinating hundreds of diverse community model architectures requires continuous backwards-compatibility testing across rapidly evolving PyTorch versions.