Langtrace

Open-source LLM tracing and evaluation solution built on OpenTelemetry for RAG evaluation. Provides automated instrumentation which records the execution path of LLM requests through multiple steps.

Open-source observability layer designed to help developers monitor and understand how their applications interact with large language models. Acts as a lightweight proxy between applications and LLM providers.

ClickHouse is a columnar OLAP database with vector indexes (ANN via AMM, brute-force), supporting SQL queries over vectors + structured data at petabyte scale. Excels in aggregations with vectors. For analytics workloads with embeddings; faster ingestion than Postgres pgvector for big data.

Cloud-native search engine for observability built on Tantivy, offering sub-second search on data stored in object storage as an open-source alternative to Datadog, Elasticsearch, Loki, and Tempo.

Open-source LLM engineering platform providing observability, metrics, evaluations, and prompt management. Integrates with OpenTelemetry, LangChain, OpenAI SDK, and vector databases for RAG pipeline monitoring.

Local LLM inference engine supporting GGUF models with hardware acceleration on Metal, CUDA, ANE, WebGPU. Features Flash Attention, MicroLoRA, RoPE, quantization (Q4-Q8, π-Quantization), MoE routing, and streaming tokens for browser and edge deployment.