Optimizely

Experience optimization suite (Mastercard) providing recommendations, targeting, and personalization without requiring vector database infrastructure. Operates at the application level with turnkey personalization and experimentation capabilities for marketing and growth teams.

AI-native personalization and hybrid search platform that replaces the need for a standalone vector DB stack. Combines hybrid search (keyword + vector retrieval), multi-stage ranking, real-time session adaptation, and business-objective modeling with warehouse-native architecture.

Automatic RAG Evaluation System - a framework for assessing RAG system quality through automated evaluation of retrieval relevance and generation accuracy without human labels.

Retrieval Augmented Generation Assessment framework for reference-free evaluation of RAG pipelines. RAGAS provides automated metrics for retrieval quality, context relevance, and generation faithfulness.

Open-source CLI and library for evaluating and red-teaming LLM applications with automated testing, security vulnerability scanning, and CI/CD integration. Recently acquired by OpenAI but remains open-source.

Comprehensive overview of frameworks and tools for evaluating RAG systems including RAGAS, TruLens, LangSmith, and ARES with metrics for retrieval quality, generation accuracy, and end-to-end performance.