Baseten

FINGER provides a fast inference framework for graph-based approximate nearest neighbor search, optimizing search path traversal to reduce query latency while maintaining high recall. Published at Web 2023.

SIGMOD 2025 paper proposing optimizations for graph-based approximate nearest neighbor search indexing on modern CPU architectures, leveraging SIMD instructions and cache-aware algorithms for improved index construction performance.

ASPLOS 2024 paper introducing Juno, a system that accelerates high-dimensional approximate nearest neighbor search using sparsity-aware algorithms and GPU ray-tracing (RT) core mapping for hardware-level computation acceleration.

SIGMOD 2025 paper introducing Tribase, a vector data query engine that uses triangle inequalities for reliable and lossless pruning compression, achieving efficient similarity search without sacrificing accuracy.

High-throughput and memory-efficient open-source LLM inference engine with PagedAttention, continuous batching, and support for embedding model serving. Widely adopted for production-scale AI inference.

Accelerated inference microservices that allow organizations to run AI models on NVIDIA GPUs anywhere with optimized inference engines, industry-standard APIs, and runtime dependencies in enterprise-grade containers.