Dr. Thomas Wolf
Co-Founder & Chief Science Officer
Co-founder & Chief Science Officer at Hugging Face. Co-created the `transformers` library, standardizing neural model hubs, tokenizers, and open-source machine learning collaboration globally, and led the BigScience international research collective behind BLOOM.
Areas of focus
Professional niches
Proof of Work
HuggingFace's Transformers: State-of-the-art Natural Language Processing
Co-created the Hugging Face `transformers` Python ecosystem, providing unified APIs across PyTorch, TensorFlow, and JAX for over 150,000 community models, powering the modern open-source AI revolution.
High-level abstractions can introduce wrapper overhead compared to bare-metal handwritten CUDA/C++ kernels.
Context: Multi-framework abstraction layer, AutoModel/AutoTokenizer design pattern.
View missionBLOOM: A 176B-Parameter Open-Access Multilingual Language Model
Initiated and directed the BigScience open scientific collaboration of 1,000+ researchers, pre-training BLOOM on the Jean Zay supercomputer across 46 natural languages and 13 programming languages.
Massive parameter size requires distributed multi-node hardware (8x A100 80GB minimum) for unquantized inference.
Context: 176B parameters, Megatron-DeepSpeed 3D parallelism, ALiBi positional embeddings.
View mission