
Ali Ghodsi
Co-Founder & CEO, Databricks | Adjunct Professor, UC Berkeley | Co-Creator of Apache Spark
Verified Proof of Work Artifacts
2 items catalogedEach artifact below represents an authenticated research publication, production code repository, or technical architectural framework directly authored or co-created by Ali Ghodsi. Every entry undergoes editorial source verification.
Databricks Mosaic AI & Lakehouse Architecture for Foundation Models
Led the engineering integration of MosaicML training and fine-tuning pipelines directly into the Databricks Lakehouse, enabling organizations to pretrain and align custom open-weight models securely on internal enterprise data lakes.
On-premise and private cloud cluster provisioning constraints can bottleneck distributed tensor parallelism across non-homogeneous GPU topologies.
The Shift from Monolithic Models to Compound AI Systems
Co-authored the influential technical treatise establishing why state-of-the-art AI applications are moving from single monolithic LLMs to compound AI systems integrating multi-step reasoning, vector databases, code execution, and external verification tools.
Multi-component compound architectures multiply system failure modes, requiring end-to-end tracing and specialized evaluation harnesses.