Tim Dettmers
Staff Research Scientist, Ai2 | Creator of bitsandbytes & QLoRA Quantization
Sources checkedTim Dettmers is a Staff Research Scientist at the Allen Institute for AI (Ai2) and former Postdoc at the University of Washington. Tim is the creator of bitsandbytes and co-author of QLoRA, breakthrough open-source technologies that democratized high-performance 4-bit and 8-bit quantization and fine-tuning on consumer GPUs.
Areas of focus
Professional niches
Proof of Work
QLoRA: Efficient Finetuning of Quantized LLMs with bitsandbytes
Quantization algorithm using 4-bit NormalFloat (NF4), double quantization, and paged optimizers to reduce fine-tuning memory footprint from >780GB to a single 48GB GPU without performance degradation.
Quantization noise can impact reasoning precision on edge-case arithmetic and strict symbolic formatting tasks.
Context: CUDA, C++, Python, Hugging Face transformers, PEFT, and PyTorch.
View mission