Dr. Alex Graves
Research Director
Research Director at NNAISENSE and former Senior Staff Research Scientist at Google DeepMind. Pioneer who invented Connectionist Temporal Classification (CTC), Neural Turing Machines (NTM), and Differentiable Neural Computers (DNC), foundational to modern sequence modeling.
Areas of focus
Professional niches
Proof of Work
Connectionist Temporal Classification: Labelling Unsegmented Sequence Data
Authored the monumental ICML 2006 paper introducing CTC loss, allowing RNNs to be trained directly on unsegmented, unaligned sequence pairs by integrating over all possible alignments with a blank token, with over 15,000 citations.
Assumes conditional independence between label outputs given the input sequence, necessitating external language models for grammar smoothing.
Context: Dynamic programming forward-backward algorithm, RNN sequence alignment.
View missionHybrid Computing Using a Neural Network with Dynamic External Memory
Published the Nature 2016 cover paper introducing Differentiable Neural Computers (DNCs), demonstrating that neural controllers coupled with readable and writable memory matrices can learn complex algorithmic logic and graph navigation.
Complex memory addressing mechanisms induce high computational overhead compared to static Transformer attention.
Context: Differentiable read/write heads, temporal linkage matrices, algorithmic reasoning.
View mission