The Excellence
Directory Platform Template

Vector Index Benchmark for Embeddings - an extensible benchmarking suite for approximate nearest neighbor search methods using modern embedding datasets. VIBE addresses limitations of traditional ANN benchmarks by focusing on contemporary embedding models and datasets.

Visual Document Retrieval benchmark designed to evaluate embedding models and retrieval systems on visually rich documents containing tables, charts, diagrams, and complex layouts. The standard benchmark for assessing multi-modal document understanding and retrieval performance.

A comprehensive benchmarking project that evaluates and compares implementations of approximate nearest neighbor algorithms. Provides standardized datasets and metrics for comparing ANN libraries including FAISS, HNSW, Annoy, and ScaNN.

An innovative benchmark suite for thoroughly evaluating vector database performance on heterogeneous data embeddings and compound queries for real-world multimodal applications.

Comprehensive benchmark suite for evaluating embedding models across 58 datasets spanning 112 languages and eight task types including retrieval, clustering, and semantic similarity, the standard for comparing embedding quality.

Massive Multilingual Text Embedding Benchmark covering over 500 quality-controlled evaluation tasks across 250+ languages, representing the largest multilingual collection of embedding model evaluation tasks.

Open-source vector database benchmarking tool testing databases across production-critical scenarios including static collection, filtering, and streaming cases with modern embedding model datasets.

Visual Document Retrieval Benchmark defining standard evaluation protocols for vision-centric document and video retrieval with 26,000 pages and 3,099 queries across 6 languages from 12,000 man-hours of annotations.

Main competition for large-scale vector database algorithms held at NeurIPS conferences. Framework for evaluating approximate nearest neighbor search algorithms on billion-scale datasets with standardized metrics and datasets.

Billion-scale approximate nearest neighbor search benchmark competition. Features datasets like SIFT1B, Deep1B with standardized evaluation metrics for comparing vector search algorithms at scale.

Billion-scale benchmark dataset containing 96-dimensional deep learning image embeddings. Provides real-world proxy for testing distributed systems and GPU-accelerated vector search at scale.