Georgi Gerganov
ggml.ai
Creator of llama.cpp and whisper.cpp, and founder of ggml.ai. Pioneered integer quantization runtime architectures that enabled running frontier large language models and speech recognition locally on consumer hardware, Apple Silicon (Metal), and commodity CPUs/GPUs without external cloud dependencies.
Areas of focus
Professional niches
Proof of Work
whisper.cpp: High-Performance Automatic Speech Recognition in Pure C/C++
Developed a pure C/C++ port of OpenAI Whisper speech recognition with zero external dependencies, streaming audio support, WebAssembly compilation, and hardware acceleration on Apple Silicon and mobile devices.
Real-time streaming requires audio buffering and speech activity detection (VAD) to prevent hallucinated audio loops.
Context: OpenAI Whisper tiny/base/small/medium/large models, 16-bit float and 4-bit/5-bit/8-bit integer quantization.
View missionllama.cpp: High-Performance C/C++ Foundation Model Inference Engine
Engineered a zero-dependency C/C++ LLM inference framework implementing 2-bit through 8-bit integer quantization (GGUF), ARM NEON, Apple Silicon Metal, CUDA, and AVX2 vector intrinsics, powering the modern local AI ecosystem.
Extreme low-bit quantizations (2-bit/3-bit) exhibit perplexity degradation on complex symbolic reasoning tasks.
Context: GGUF quantization format, Llama 2/3, Mistral, Qwen, DeepSeek; pure C/C++ runtime.
View mission