Yoshua Bengio
Turing Award Laureate | Scientific Director, Mila | Full Professor, Université de Montréal
Verified Proof of Work Artifacts
2 items catalogedEach artifact below represents an authenticated research publication, production code repository, or technical architectural framework directly authored or co-created by Yoshua Bengio. Every entry undergoes editorial source verification.
Neural Machine Translation by Jointly Learning to Align and Translate (Additive Attention)
Co-authored the milestone paper introducing the attention mechanism into sequence-to-sequence translation, allowing decoders to dynamically attend to relevant input positions and directly inspiring the Transformer architecture.
Recurrent sequential processing precluded massive cluster-scale parallelization.
A Neural Probabilistic Language Model
Introduced the seminal concept of learning continuous distributed word feature vectors alongside statistical language modeling, defeating the curse of dimensionality and establishing modern neural language modeling.
Computational bottleneck in softmax normalization over large vocabularies prior to hierarchical softmax and negative sampling.