• Home
  • Categories
  • Tags
  • Pricing
  • Submit
    Decorative pattern
    1. Home
    2. Benchmarks & Evaluation
    3. MyScale's Vector Database Benchmark

    MyScale's Vector Database Benchmark

    Benchmark results and tools by MyScale aimed at measuring the performance of vector databases in various search and retrieval tasks.

    🌐Visit Website

    About this tool

    MyScale's Vector Database Benchmark

    Category: Benchmarks & Evaluation
    Source: GitHub Repository

    Description

    MyScale's Vector Database Benchmark is an open-source framework designed to assess the performance of fully-managed vector databases across various search and retrieval tasks. It provides tools and datasets for benchmarking and delivers comparative results for different vector database solutions.

    Features

    • Benchmarking Framework: Tools to run standardized performance benchmarks on fully-managed vector databases.
    • Supported Databases: Includes out-of-the-box support for popular vector databases such as Pinecone, Weaviate, Milvus, Qdrant, and MyScale.
    • Workload Types: Measures throughput and cost-performance for both standard vector search and filtered vector search workloads.
    • Cost-Performance Analysis: Calculates cost-performance ratio by dividing monthly cost by queries per second (QPS), enabling cost-effectiveness comparisons.
    • Dataset Management: Provides scripts and modules for dataset preparation and upload optimization.
    • Experiment Management: Organizes and automates experiments for reproducible benchmarking across multiple services.
    • Results Visualization: Supports visualization of benchmark results for easier comparison and analysis.
    • Open Source: Licensed under Apache-2.0 and extensible for custom needs.
    • Hybrid Search Support: Includes support for hybrid search scenarios in MyScale.
    • Docker Support: Includes Dockerfiles for containerized environments.

    Pricing

    Not applicable. This is an open-source tool available for free under the Apache-2.0 license.

    Tags

    benchmark vector-databases performance retrieval

    Surveys

    Loading more......

    Information

    Websitegithub.com
    PublishedMay 13, 2025

    Categories

    1 Item
    Benchmarks & Evaluation

    Tags

    4 Items
    #Benchmark#vector databases#Performance#Retrieval

    Similar Products

    6 result(s)
    Qdrant's Vector Database Benchmarks

    A set of benchmarks provided by Qdrant for evaluating vector databases, focusing on speed, scalability, and accuracy of vector search operations.

    ANN-Benchmarks

    A comprehensive benchmarking project that evaluates and compares implementations of approximate nearest neighbor algorithms. Provides standardized datasets and metrics for comparing ANN libraries including FAISS, HNSW, Annoy, and ScaNN.

    VectorDBBench

    Open-source vector database benchmarking tool testing databases across production-critical scenarios including static collection, filtering, and streaming cases with modern embedding model datasets.

    Billion-scale ANNS Benchmarks

    A benchmarking resource for evaluating approximate nearest neighbor search (ANNS) methods on billion-scale datasets, highly relevant for assessing the scalability of vector databases.

    ACL 2023 Tutorial: Retrieval-Based Language Models and Applications

    This ACL 2023 tutorial reviews retrieval-based language models, which often rely on vector databases and vector search systems to retrieve relevant context. The tutorial covers methods and applications central to the use of vector databases in modern NLP systems.

    MTEB Leaderboard
    Featured

    Massive Text Embedding Benchmark leaderboard covering 58 datasets across 112 languages and 8 embedding tasks. Industry-standard benchmark for comparing text embedding models.

    Decorative pattern
    Built with
    Ever Works
    Ever Works

    Connect with us

    Stay Updated

    Get the latest updates and exclusive content delivered to your inbox.

    Product

    • Categories
    • Tags
    • Pricing
    • Help

    Clients

    • Sign In
    • Register
    • Forgot password?

    Company

    • About Us
    • Admin
    • Sitemap

    Resources

    • Blog
    • Submit
    • API Documentation
    All product names, logos, and brands are the property of their respective owners. All company, product, and service names used in this repository, related repositories, and associated websites are for identification purposes only. The use of these names, logos, and brands does not imply endorsement, affiliation, or sponsorship. This directory may include content generated by artificial intelligence.
    Copyright © 2025 Awesome Vector Databases. All rights reserved.·Terms of Service·Privacy Policy·Cookies