ANN-Benchmarks
ANN-Benchmarks is a benchmarking platform specifically for evaluating the performance of approximate nearest neighbor (ANN) search algorithms, which are foundational to vector database evaluation and comparison.
About this tool
ANN-Benchmarks
ANN-Benchmarks is a benchmarking environment for evaluating the performance of approximate nearest neighbor (ANN) search algorithms. It provides a platform to compare algorithms across multiple datasets and distance measures.
Features
- Benchmarking Platform: Offers comprehensive benchmarking for a wide range of approximate nearest neighbor algorithms.
- Multiple Datasets: Includes datasets such as glove, nytimes, fashion-mnist, gist, sift, word2bits, kosarak, and more, covering various data types and dimensionalities.
- Variety of Distance Measures: Supports benchmarking on different distance metrics, including Angular, Euclidean, Hamming, and Jaccard.
- Algorithm Coverage: Benchmarks a large selection of algorithms, including faiss-ivf, scann, pgvector, annoy, glass, hnswlib, BallTree(nmslib), vald(NGT-anng), hnsw(faiss), qdrant, n2, Milvus(Knowhere), mrpt, redisearch, SW-graph(nmslib), pynndescent, vearch, flann, luceneknn, weaviate, puffinn, elastiknn-l2lsh, sptag, ckdtree, opensearchknn, datasketch, and more.
- Interactive Results: Provides interactive plots and detailed statistics for each benchmark, including recall, queries per second, index size, and build time.
- Open Source Collaboration: Users can contribute new algorithms or improvements via pull requests on GitHub.
- Results Visualization: Results are split by distance measure and dataset, with summary plots for quick comparison.
Pricing
No pricing information is provided; ANN-Benchmarks is an open-source benchmarking platform.
Links
Loading more......
Information
Categories
Tags
Similar Products
6 result(s)An annual competition focused on similarity search and indexing algorithms, including approximate nearest neighbor methods and high-dimensional vector indexing, providing benchmarks and results relevant to vector database research.
The open‑source repository containing the implementation, configuration, and scripts of VectorDBBench, enabling users to run standardized benchmarks across multiple vector database systems locally or in CI.
WEAVESS is an open-source benchmarking and evaluation framework for graph-based approximate nearest neighbor (ANN) search methods, providing code and experiments for large-scale vector similarity search. It is useful for researchers and practitioners comparing vector indexing algorithms for vector databases and AI search applications.
BEIR (Benchmarking IR) is a benchmark suite for evaluating information retrieval and vector search systems across multiple tasks and datasets. Useful for comparing vector database performance.
A benchmarking resource for evaluating approximate nearest neighbor search (ANNS) methods on billion-scale datasets, highly relevant for assessing the scalability of vector databases.
Benchmark results and tools by MyScale aimed at measuring the performance of vector databases in various search and retrieval tasks.