PUBLISHED AI RESEARCH AND PROJECTS

AI research and projects

The research, projects, and explanations behind the people. Read the source, inspect verified code and models, and find a collaborator.

Clear all filters

A source check confirms that a source supports the summary. It is not an independent replication or endorsement. Our methodology ↗

Showing 81–96 of 149 proofs of work · Kind: research · Newest first
Page 6 of 10
researchChecked Sep 21, 2026

Flash-Decoding: Accelerating Long-Context LLM Inference via Partitioned Attention

Dr. Sasha Rush · Cornell Tech / Hugging Face

Co-developed Flash-Decoding, an inference parallelization algorithm that partitions key-value caches across thread blocks during token generation, delivering up to 8x speedup on 64k+ context sequences.

Scope & limitations

Requires reduction step across partitions that introduces minor overhead for very short sequence lengths.

Context: CUDA kernels, split-KV cache reduction, integrated into vLLM, TensorRT-LLM, and PyTorch 2.2.

View mission
researchChecked Sep 21, 2026

High-Resolution Image Synthesis with Latent Diffusion Models (Stable Diffusion)

Dr. Robin Rombach · Black Forest Labs

Lead author of the landmark CVPR 2022 paper introducing Latent Diffusion Models (LDMs), shifting diffusion training from raw pixel space into a compressed latent perceptual space, unlocking consumer GPU diffusion synthesis.

Scope & limitations

Fine spatial details (e.g., distant human hands or miniature typography) can suffer perceptual compression loss in the VAE latent space.

Context: Autoencoder latent space (8x downsampling), cross-attention conditioning, UNet denoising backbone.

View mission
researchChecked Sep 21, 2026

Highly Accurate Protein Structure Prediction with AlphaFold

Dr. Demis Hassabis · Google DeepMind

Senior author of the landmark Nature 2021 publication demonstrating atomic-accuracy prediction of 3D protein structures from amino acid sequences, resolving a 50-year grand challenge in molecular biology.

Scope & limitations

Conformational dynamics in intrinsically disordered regions remain challenging without empirical laboratory validation.

Context: Evoformer attention network, Invariant Point Attention (IPA) 3D coordinate frame refinement.

View mission
researchChecked Sep 21, 2026

KILT: Benchmarking Knowledge Intensive Language Tasks for Grounded Generation

Dr. Patrick Lewis · Cohere

Developed the KILT benchmark standardizing evaluation across open-domain QA, fact checking, entity linking, and dialogue, measuring both answer generation accuracy and provenance attribution.

Scope & limitations

Corpus snapshot drift requires periodic index refreshes to keep knowledge-intensive models updated with real-world facts.

Context: Unified Wikipedia corpus snapshot with passage-level attribution targets.

View mission
researchChecked Sep 21, 2026

Masked Autoencoders Are Scalable Vision Learners (MAE)

Dr. Kaiming He · MIT EECS

Developed Masked Autoencoders (MAE), proving that masking 75% of image patches and using an asymmetric vision transformer autoencoder allows models to learn rich visual representations self-supervised at massive scale.

Scope & limitations

Requires substantial pre-training compute and large unlabeled image datasets for optimal self-supervised convergence.

Context: Vision Transformer (ViT-Large/Huge), asymmetric encoder-decoder, 75% random masking.

View mission
researchChecked Sep 21, 2026

Mastering the Game of Go with Deep Neural Networks and Tree Search (AlphaGo)

Dr. Demis Hassabis · Google DeepMind

Directed the historic AlphaGo project that combined deep convolutional value/policy networks with Monte Carlo Tree Search (MCTS) to defeat 18-time world champion Lee Sedol in Go.

Scope & limitations

Required massive simulated game rollouts; subsequent AlphaZero generalized the principle without human game data.

Context: Self-play reinforcement learning, policy and value convolutional networks, asynchronous MCTS.

View mission
researchChecked Sep 21, 2026

MLIR: Multi-Level Intermediate Representation for Heterogeneous AI Accelerators

Dr. Chris Lattner · Modular

Co-authored the landmark paper establishing MLIR, a unified compiler framework that bridges high-level machine learning graphs with diverse hardware accelerators (GPUs, TPUs, custom ASICs) through extensible dialects.

Scope & limitations

Dialect conversions require rigorous domain-specific lowering pipelines for novel specialized silicon.

Context: C++ compiler framework, LLVM backend, dialect ecosystem (Linalg, Affine, Vector, GPU).

View mission
researchChecked Sep 21, 2026

Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networks (MAML)

Dr. Chelsea Finn · Stanford University

Authored the landmark ICML 2017 paper creating MAML, a gradient-based meta-learning algorithm that optimizes neural network initializations so that models can learn new tasks from only a few gradient steps.

Scope & limitations

Second-order Hessian computations impose high memory overhead during meta-training iterations.

Context: Second-order meta-gradient optimization across few-shot classification and robotic continuous control.

View mission
researchChecked Sep 21, 2026

Open X-Embodiment: Robot Learning Datasets and Generalist Policies (RT-X)

Dr. Chelsea Finn · Stanford University

Co-led the global Open X-Embodiment consortium uniting 33 academic laboratories across 22 robot types to train RT-X, the world's largest open multi-embodiment robotic policy.

Scope & limitations

Cross-robot embodiment generalization degrades when sensor modalities or physical gripper geometries differ substantially.

Context: 1M+ robotic trajectory demonstrations across Franka, UR5, Aloha, and mobile manipulators.

View mission
researchChecked Sep 21, 2026

Parameter-Efficient Transfer Learning for NLP (Foundational PEFT Adapters)

Dr. Colin Raffel · University of Toronto / Vector Institute

Co-authored the landmark ICML 2019 paper introducing lightweight adapter modules injected into transformer layers, proving models could learn new tasks with less than 3% added parameters.

Scope & limitations

Serial adapter bottlenecks add minor inference latency compared to re-parameterization techniques like LoRA.

Context: Bottleneck projection adapters inserted after multi-head attention and feedforward layers.

View mission
researchChecked Sep 21, 2026

Proximal Policy Optimization Algorithms (PPO)

Dr. John Schulman · Anthropic / Thinking Machines

Invented PPO, a clipped objective reinforcement learning algorithm that maintains policy stability during stochastic gradient descent, which became the global algorithmic standard for aligning LLMs via RLHF.

Scope & limitations

Hyperparameter sensitivity to KL penalty coefficients and reward model reward hacking.

Context: Clipped surrogate objective, generalized advantage estimation (GAE), actor-critic networks.

View mission
researchChecked Sep 21, 2026

Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks

Dr. Patrick Lewis · Cohere

Authored the foundational NeurIPS 2020 paper defining Retrieval-Augmented Generation (RAG), introducing end-to-end differentiable architectures that ground generative models against external non-parametric neural indices.

Scope & limitations

Early RAG formulated single-step retrieval; complex multi-hop reasoning requires iterative or agentic retrieval loops.

Context: DPR (Dense Passage Retriever) coupled with BART sequence-to-sequence generation over Wikipedia index.

View mission
researchChecked Sep 21, 2026

RewardBench: Evaluating Reward Models for Language Model Alignment

Nathan Lambert, Ph.D. · Allen Institute for AI (Ai2)

Created RewardBench, the industry's primary benchmark for evaluating reward models and preference classifiers across chat capabilities, reasoning, and adversarial safety edge cases.

Scope & limitations

Static evaluation test sets face saturation as training data mixtures incorporate benchmark distributions.

Context: Evaluation suite assessing over 100 reward models across Chat, Reasoning, and Safety axes.

View mission
researchChecked Sep 21, 2026

SimCSE: Simple Contrastive Learning of Sentence Embeddings

Dr. Danqi Chen · Princeton University

Created SimCSE, an unsupervised contrastive learning framework that uses standard dropout as data augmentation to learn state-of-the-art sentence embeddings, advancing semantic retrieval without labeled pairs.

Scope & limitations

Sentence embeddings compress entire paragraphs into single fixed-size vectors, losing granular token-level context.

Context: BERT and RoBERTa backends with contrastive temperature scaling.

View mission
researchChecked Sep 21, 2026

SmoothQuant: Accurate and Efficient Post-Training Quantization for Large Language Models

Dr. Song Han · MIT / HAN Lab

Invented SmoothQuant, an algorithm that mathematically splits quantization difficulty between activations and weights via per-channel scaling transformations, unlocking 8-bit weight and activation (W8A8) tensor-core acceleration.

Scope & limitations

Requires support for per-token dynamic scaling or fixed calibration scale tensors in runtime engines.

Context: INT8 matrix multiplications on NVIDIA Ampere/Ada Lovelace tensor cores.

View mission
researchChecked Sep 21, 2026

The Hardware Lottery: Algorithmic Stagnation and Hardware Alignment

Dr. Sarah Hooker · Cohere For AI

Authored the CACM article formalizing the 'hardware lottery', demonstrating how deep learning architectures win not on fundamental superiority but on whether they fit contemporary GPU and accelerator architectures.

Scope & limitations

Qualitative and historical systems critique; guiding architectural paradigms rather than releasing a standalone model.

Context: Historical analysis of neural networks, specialized ASICs, and modern transformer tensor architectures.

View mission
Showing 81–96 of 149 proofs of work