Billion-Scale Vector Search on Object Storage
Vector Search at Scale: How Notion Built Billion-Vector Search Infrastructure | Explore the architecture behind Notion's enterprise-scale vector search system, powering one of the largest semantic search implementations in production. Learn advanced techniques in embedding pipeline design, distributed vector processing, and optimal storage strategies using Spark and Turbopuffer. This technical deep-dive covers LSM indexing, RAG (Retrieval Augmented Generation) implementation, and practical approaches to query optimization. Discover battle-tested strategies for building and scaling production-ready vector search systems capable of handling billions of vectors with high performance and reliability.