Open-source observability for GenAI and LLM applications based on OpenTelemetry, providing AI-aware instrumentation for vector databases, LLM frameworks, and model providers.
Loading more......
OpenLLMetry is a set of extensions built on top of OpenTelemetry that provides complete observability over LLM applications. It enables monitoring and debugging through non-intrusive tracing that captures LLM-specific data and metrics.
OpenLLMetry extends OpenTelemetry with AI-aware instrumentation that captures:
OpenLLMetry provides custom extensions that instrument vector database calls including:
Built-in instrumentations for:
Uses OpenTelemetry protocol to connect with:
Apache 2.0 License