Portkey

An open-source LLM observability and evaluation platform that provides comprehensive tracking, monitoring, and evaluation capabilities for large language model applications. Designed for production AI systems with focus on debugging and performance optimization.

Open-source observability for GenAI and LLM applications based on OpenTelemetry, providing AI-aware instrumentation for vector databases, LLM frameworks, and model providers.

RAG-powered text-to-SQL framework that enables natural language querying of SQL databases using vector search for retrieval of relevant schema, documentation, and example queries.

Production-grade observability and evaluation platform for LLM applications from LangChain, providing tracing, debugging, prompt evaluation, and performance monitoring for reliable LLM workflows in development and production.

Open-source evaluation and tracing library for AI agents and RAG systems, combining OpenTelemetry-based tracing with trustworthy evaluations including ground truth metrics and LLM-as-a-Judge feedback for production monitoring.

Open-source LLM tracing and evaluation solution built on OpenTelemetry for RAG evaluation. Provides automated instrumentation which records the execution path of LLM requests through multiple steps.