Opik

Open-source observability layer designed to help developers monitor and understand how their applications interact with large language models. Acts as a lightweight proxy between applications and LLM providers.

Comprehensive observability solution for vector databases through Zilliz Cloud integration, providing metrics for QPS, latency, slow queries, and failure rates alongside full stack monitoring.

Production-grade observability and evaluation platform for LLM applications from LangChain, providing tracing, debugging, prompt evaluation, and performance monitoring for reliable LLM workflows in development and production.

Built-in GUI introduced in Milvus v2.5 for system observability, offering real-time monitoring of system health, collection management, and query optimization from a unified dashboard.

Open-source LLM tracing and evaluation solution built on OpenTelemetry for RAG evaluation. Provides automated instrumentation which records the execution path of LLM requests through multiple steps.