AI research and projects
The research, projects, and explanations behind the people. Read the source, inspect verified code and models, and find a collaborator.
A source check confirms that a source supports the summary. It is not an independent replication or endorsement. Our methodology ↗
The Annotated Transformer: A Line-by-Line PyTorch Implementation
Dr. Sasha Rush · Cornell Tech / Hugging FaceAuthored the universally referenced educational codebase providing an exact, executable line-by-line PyTorch implementation of 'Attention Is All You Need', bridging theoretical tensor math with production code.
Presents vanilla quadratic multi-head attention without later FlashAttention or grouped-query optimizations.
Context: PyTorch tensor operations, multi-head attention, positional encoding, and beam search decoding.
View missionmicrograd: Minimal Scalar-Valued Autograd Engine with Dynamic DAG Visualization
Andrej Karpathy · Eureka Labs / ex-Tesla, OpenAIA foundational, pedagogical autograd engine implementing reverse-mode autodiff over dynamically constructed Directed Acyclic Graphs (DAGs) in approximately 100 lines of pure Python, alongside a multi-layer perceptron (MLP) library that replicates PyTorch's core tensor mechanics from first principles.
Operates on individual scalar values rather than vectorized multidimensional tensors, making it unsuitable for training production models beyond small educational datasets.
Context: Pure Python 3.10+, scalar-valued autodiff DAG, Graphviz topological computation graph visualization.
View missionThe Deplatformable Guide to Local LLMs and Self-Hosted Data Sovereignty
Paul Macko · Deplatformable / Macko MediaPublished an authoritative guide detailing the hardware specifications, quantization trade-offs (GGUF, EXL2), and network sandboxing needed to run private foundation models offline on consumer Apple Silicon and NVIDIA workstations.
Consumer hardware memory limits restrict inference speeds when running 70B parameter models without substantial unified RAM.
Context: Ollama, LM Studio, llama.cpp, Llama 3 8B/70B quantized models.
View missionAI Snake Oil: What Computers Can, Can't, and Shouldn't Do
Dr. Sayash Kapoor · Princeton UniversityDeveloped the analytical distinction between perception AI (generative synthesis, speech recognition) and predictive AI (predicting human recidivism, job success), providing rigorous frameworks for evaluating claims of AI accuracy in business and governance.
Practical applications in enterprise require navigating existing regulatory guidelines that may lag behind empirical machine learning consensus.
Context: Statistical risk assessment, cross-entropy evaluation, algorithmic bias metrics in high-stakes human systems.
View missionAuditing Multimodal Generative Systems for Representational and Allocative Harm
Dr. Margaret Mitchell · Hugging FaceFormulated structured auditing protocols for text-to-image and multimodal foundation models, measuring bias propagation across CLIP embeddings, latent diffusion prompt expansions, and synthetic face generation.
Balancing automated quantitative metric auditing with contextual qualitative evaluation requires domain-specific sociological input.
Context: CLIP, Stable Diffusion, demographic diversity benchmarking over fine-grained prompt variations.
View missionFive Levels of LLM Document Summarization Architecture
Greg Kamradt · Data IndependentDeveloped the definitive open-source architectural taxonomy for document summarization, categorizing approaches from Stuffing and Map-Reduce to Refine, LangChain Agentic Chunking, and Hierarchical Clustering.
Map-Reduce architectures can lose connective narrative thread across disparate document chapters without cross-chunk summarization passes.
Context: LangChain, tiktoken, vector embedding distance clustering, recursive text splitters.
View missionThe Full Stack LLM Bootcamp: End-to-End Enterprise LLM Production Engineering
Charles Frye · Modal LabsDesigned and delivered the comprehensive Full Stack LLM Bootcamp, educating tens of thousands of software engineers on prompt design, fine-tuning with LoRA/QLoRA, vector retrieval, evaluation metrics, and cost-efficient deployment.
Rapid evolution in model capabilities requires constant curriculum revisions to address frontier tool-calling interfaces.
Context: PyTorch, Hugging Face, vLLM, LangChain, Modal serverless GPU runtimes.
View missionThe Open LLM Leaderboard: Standardized Evaluation for Open Foundation Models
Clem Delangue · Hugging FaceEstablished the Open LLM Leaderboard utilizing the LM Evaluation Harness to provide transparent, reproducible, contamination-checked benchmarks (MMLU-Pro, GSM8k, IFEval, MuSR, MATH) across thousands of community LLMs.
Benchmarks face test set leakage risks over time; static multiple-choice formats do not fully evaluate conversational agency or multi-turn tool calling.
Context: Automated cluster evaluating FP16/BF16 weights on standardized EleutherAI LM Evaluation Harness test suites.
View missionWorld Labs Spatial Intelligence & 3D Interactive World Foundation
Dr. Fei-Fei Li · Stanford University / World LabsFormulated the foundational thesis on Spatial Intelligence for Generative AI, moving beyond 2D multimodal pixel generation to 3D world models capable of understanding physics, geometry, spatial permanence, and embodied navigation.
Reconstructing physically coherent 3D environments in real-time from single-view 2D prompts demands substantial compute and specialized geometric representation priors.
Context: 3D Gaussian Splatting, NeRF, Diffusion Transformers for spatial coordinate generation.
View missionAI Tool Report: Applied Generative AI Playbook & Workflow Integration Guide
Martin Crowley · AI Tool ReportA comprehensive practitioner field guide authored by Martin Crowley at AI Tool Report, training professionals on advanced prompt engineering, context management, and practical multi-modal generative workflows.
Curriculum and operational methodology; adoption requires active practitioner execution and organizational enablement.
Context: Curated across contemporary multi-modal foundation models and reasoning architectures.
View missionBoardroom Governance Framework for High-Consequence AI Systems
Dr. Eva-Marie Muller-Stuler · DrEva.aiA comprehensive governance methodology authored by Dr. Eva-Marie Muller-Stuler for sovereign wealth funds, health systems, and financial boards to manage operational risk, model drift, and institutional liability.
Governance advisory protocol; institutional compliance requires ongoing audit committee oversight.
Context: Aligned with European AI Act requirements and international high-risk AI regulatory standards.
View missionCertainty Lab: Enterprise AI Governance & Operational Risk Management Framework
Dr. Yiftach Golov · Certainty LabA structured governance methodology developed by Dr. Yiftach Golov at Certainty Lab, establishing organizational guardrails, vendor evaluation criteria, and model validation standards for enterprise adoption.
Strategic governance advisory framework; regulatory compliance requirements must be validated against regional legal statutes.
Context: Aligned with NIST AI RMF, ISO 42001, and corporate information security standards.
View missionEnterprise AI Solution Discovery & Scoping Blueprint
Liam Ottley · Morningside AIA structured agency methodology developed by Liam Ottley detailing how systems integrators can audit enterprise bottlenecks, price custom AI agents, and build defensible client delivery agreements.
Business consulting blueprint; technical automation success depends on client API access and data readiness.
Context: Tailored for enterprise workflow integration using Make, n8n, LangGraph, and Supabase.
View missionEnterprise Generative AI Procurement & Vendor Evaluation Checklist
Allie K. Miller · Allie K. Miller ConsultingAn actionable enterprise procurement guide by Allie K. Miller establishing rigorous evaluation criteria for selecting foundation model vendors, API SLAs, data privacy boundaries, and cost-per-token economics.
Procurement decision framework; technical vendor roadmaps and enterprise pricing tiers fluctuate frequently.
Context: Covers evaluation criteria for OpenAI, Anthropic, Azure AI, AWS Bedrock, and open-weight providers.
View missionPeripety Media: Applied Generative AI Playbook & Workflow Integration Guide
Mark Hinkle · Peripety MediaA comprehensive practitioner field guide authored by Mark Hinkle at Peripety Media, training professionals on advanced prompt engineering, context management, and practical multi-modal generative workflows.
Curriculum and operational methodology; adoption requires active practitioner execution and organizational enablement.
Context: Curated across contemporary multi-modal foundation models and reasoning architectures.
View missionRealmIQ Spatial Media & Generative Branding Architecture
Curt Doty · RealmIQA strategic analysis by Curt Doty exploring the convergence of spatial computing, multi-modal brand storytelling, and real-time generative interfaces for modern digital creative agencies.
Creative strategy analysis; spatial asset generation throughput is constrained by current 3D generative model resolution.
Context: Analyzes NeRF, Gaussian Splatting, and generative video pipeline implementations.
View mission