PUBLISHED AI RESEARCH AND PROJECTS

AI research and projects

The research, projects, and explanations behind the people. Read the source, inspect verified code and models, and find a collaborator.

A source check confirms that a source supports the summary. It is not an independent replication or endorsement. Our methodology ↗

Showing 369–384 of 567 proofs of work · Newest first
Page 24 of 36
researchChecked Sep 20, 2026

ColBERT: Efficient and Effective Passage Search via Contextualized Late Interaction over BERT

Dr. Omar Khattab · Stanford University

Invented ColBERT, a neural retrieval model utilizing late interaction over token-level representations rather than collapsing documents into a single dense vector, achieving cross-encoder retrieval quality with millisecond vector search latency.

Scope & limitations

Multi-vector token index storage requires larger RAM and disk allocations than single-vector embedding stores unless aggressive centroid quantization (ColBERTv2 / PLAID) is applied.

Context: Token-level BERT embeddings, MaxSim operator, PLAID index compression.

View mission
researchChecked Sep 20, 2026

Datasheets for Datasets: Standardized Transparency Protocol

Dr. Timnit Gebru · Distributed AI Research Institute (DAIR)

Co-authored the CACM benchmark paper establishing 'Datasheets for Datasets', standardizing documentation of motivation, composition, collection process, preprocessing, and recommended uses across machine learning training datasets.

Scope & limitations

Compliance is self-reported by dataset creators; verification requires independent audits and automated dataset inspection tooling.

Context: Public policy, dataset governance, and risk mitigation framework adopted across major ML labs.

View mission
researchChecked Sep 20, 2026

De-anonymization and Privacy Risks in Large-Scale Data Platforms

Dr. Arvind Narayanan · Princeton University

Proved that high-dimensional datasets (Netflix Prize, social graphs) can be re-identified with high probability using sparse auxiliary information, refuting the concept of 'anonymized' behavioral data in machine learning training sets.

Scope & limitations

Modern differential privacy mechanisms mitigate some vulnerability but introduce bounded utility trade-offs in downstream model training.

Context: High-dimensional matrix factorizations, graph matching algorithms, differential privacy formulations.

View mission
researchChecked Sep 20, 2026

DSPy Assertions: Computational Constraints for Self-Refining Language Model Pipelines

Dr. Omar Khattab · Stanford University

Authored the DSPy Assertions paradigm, introducing computational assertions and suggestions directly into declarative LM graphs, enabling pipelines to self-correct upon constraint failure without manual prompt rewriting.

Scope & limitations

Backtracking loops require hard iteration ceilings to avoid infinite retry loops when models encounter unresolvable logical contradictions.

Context: Dynamic backtracking execution graph in Python, automated metric validation.

View mission
implementationChecked Sep 20, 2026

DSPy: Compiling Declarative Language Model Calls into State-of-the-Art Pipelines

Dr. Matei Zaharia · Databricks / UC Berkeley

Co-created DSPy, a programming framework that abstracts brittle prompt engineering into typed declarative modules (Predict, ChainOfThought, ProgramOfThought) and uses optimizers (BootstrapFewShot, MIPRO) to compile optimal few-shot prompts and weight updates automatically.

Scope & limitations

Compiling complex multi-step pipelines requires running multiple optimization iterations, incurring upfront LLM invocation tokens during the optimization phase.

Context: Python 3.10+, automated LLM teleprompter evaluation harnesses, supports local vLLM and remote API providers.

View mission
researchChecked Sep 20, 2026

Emergent Abilities of Large Language Models

Dr. Jason Wei · OpenAI

Published the influential study demonstrating that certain capabilities (multi-step arithmetic, translation, symbolic reasoning) are not present in smaller models and emerge non-linearly only once compute and parameter scales cross critical thresholds.

Scope & limitations

Metric non-linearities (such as exact-string match versus continuous token log-likelihood) can exaggerate the appearance of abrupt phase transitions.

Context: Empirical analysis across PaLM, GPT-3, Gopher, Chinchilla, and LaMDA across dozens of benchmark evaluations.

View mission
implementationChecked Sep 20, 2026

Enterprise AI Chatbot Architecture with Multi-Tenant RBAC

Rahul Patel · Space-O Technologies / ManageMyClaw

Architected a multi-tenant enterprise knowledge base system supporting enterprise role-based access control (RBAC), ensuring sensitive corporate documents are retrievable only by authorized employee access tiers.

Scope & limitations

Large document corpora require periodic vector re-indexing when permission ACLs are updated dynamically in Active Directory.

Context: LangChain, Pinecone vector database, Azure OpenAI Service, OAuth 2.0 / SAML integration.

View mission
implementationChecked Sep 20, 2026

Enterprise LLM Guardrail and PII Anonymization Middleware

Helena García Borrella · The Interactive Studio / Codebridge Tech

Built a low-latency proxy middleware that detects and redacts GDPR-regulated personally identifiable information (PII) before queries are routed to public foundation model APIs.

Scope & limitations

Highly domain-specific acronyms can trigger false positive redactions unless explicitly whitelisted in custom dictionary sets.

Context: Microsoft Presidio, spaCy Spanish/English NER models, Redis cache layer.

View mission
researchChecked Sep 20, 2026

Evaluating the Fairness and Accuracy of Algorithmic Risk Assessment Instruments

Dr. Arvind Narayanan · Princeton University

Authored the classic tutorial and survey demonstrating the mathematical impossibility of satisfying three common notions of algorithmic fairness simultaneously, proving the need for explicit ethical trade-offs in automated scoring.

Scope & limitations

Mathematical trade-off proofs assume stationary data distributions and cannot resolve normative political disagreements regarding priority.

Context: COMPAS recidivism scores, credit risk models, calibration vs error-rate parity statistical constraints.

View mission
researchChecked Sep 20, 2026

Fast Transformer Decoding: One Write-Head is All You Need (Multi-Query Attention)

Noam Shazeer · Google DeepMind

Authored the foundational paper introducing Multi-Query Attention (MQA), where all attention heads share a single key and value head. This drastically slashes memory bandwidth consumption during autoregressive generation by up to 10x with negligible accuracy drop.

Scope & limitations

Slightly reduces representational capacity in small model regimes compared to standard multi-head attention before being mitigated by modern GQA configurations.

Context: Decoupled query/key/value projection matrices; foundation for Grouped-Query Attention (GQA) across modern LLMs like Llama 3 and Mistral.

View mission
explanationChecked Sep 20, 2026

Five Levels of LLM Document Summarization Architecture

Greg Kamradt · Data Independent

Developed the definitive open-source architectural taxonomy for document summarization, categorizing approaches from Stuffing and Map-Reduce to Refine, LangChain Agentic Chunking, and Hierarchical Clustering.

Scope & limitations

Map-Reduce architectures can lose connective narrative thread across disparate document chapters without cross-chunk summarization passes.

Context: LangChain, tiktoken, vector embedding distance clustering, recursive text splitters.

View mission
researchChecked Sep 20, 2026

GLU Variants Improve Transformer (SwiGLU Activation Function)

Noam Shazeer · Google DeepMind

Formulated and benchmarked Gated Linear Unit variants (GLU, Bilinear, ReGLU, GEGLU, SwiGLU) for transformer feedforward layers, demonstrating that SwiGLU consistently outperforms standard ReLU and GELU activations.

Scope & limitations

Requires three weight matrices in feedforward blocks instead of two, requiring adjustments to intermediate hidden dimensions to maintain equivalent parameter counts.

Context: Swish-gated linear projections: SwiGLU(x) = Swish(xW) * (xV).

View mission
implementationChecked Sep 20, 2026

High-Concurrency Web Scraping and Vector Ingestion Pipeline

Raúl Pineda Mejía · Codebridge Tech / The Interactive Studio

Built an asynchronous distributed scraping pipeline using headless browsers and vector databases that processes 50,000 corporate pages daily, generating semantic chunks and indexing them into Qdrant for semantic search.

Scope & limitations

Dynamic anti-bot protections require continuous proxy rotation and rate limit backoff strategies.

Context: Node.js, Puppeteer, Qdrant vector database, OpenAI text-embedding-3-small.

View mission
implementationChecked Sep 20, 2026

Hugging Face Transformers Platform & Open Weights Ecosystem

Clem Delangue · Hugging Face

Co-created and scaled the Hugging Face platform, which provides standardized APIs and model abstractions for PyTorch, TensorFlow, and JAX across hundreds of thousands of state-of-the-art transformer checkpoints.

Scope & limitations

Coordinating hundreds of diverse community model architectures requires continuous backwards-compatibility testing across rapidly evolving PyTorch versions.

Context: PyTorch, SafeTensors, ONNX, vLLM, DeepSpeed, BitsAndBytes quantization backends.

View mission
researchChecked Sep 20, 2026

ImageNet: A Large-Scale Hierarchical Image Database

Dr. Fei-Fei Li · Stanford University / World Labs

Spearheaded the creation and curation of ImageNet, an ontological visual dataset containing over 14 million annotated images across 20,000 synsets, which launched the annual ImageNet Large Scale Visual Recognition Challenge (ILSVRC) and ignited AlexNet and deep learning.

Scope & limitations

Class distributions reflected internet imagery availability at the time; subsequent audits addressed cultural and geographical representation biases.

Context: WordNet hierarchy mapping, Amazon Mechanical Turk crowdsourced quality verification protocol.

View mission
researchChecked Sep 20, 2026

Interpretability Beyond Feature Attribution: Quantitative Testing with Concept Activation Vectors (TCAV)

Dr. Been Kim · Google DeepMind

Invented TCAV (Testing with Concept Activation Vectors), an interpretability framework that uses directional derivatives in activation space to quantify how much a human-understandable concept (e.g., stripes on a zebra) contributes to a model's prediction.

Scope & limitations

Requires user-provided exemplars for concept definitions; high-level abstract concepts without clear visual or lexical exemplars can be difficult to vectorize cleanly.

Context: InceptionV3, ResNet internal activation layers, linear classifiers in latent embedding manifolds.

View mission
Showing 369–384 of 567 proofs of work