Unstructured

An open-source, LLM-powered document processing engine for ETL, RAG, and analytics on unstructured data, featuring a DocSet abstraction similar to Apache Spark and delivering 6x more accurate data chunking with 2x improved recall for hybrid search.

Advanced document parsing service from LlamaIndex for extracting structured data from PDFs, PowerPoints, and Word documents. Uses LLMs to understand document structure and maintain layout information.

Open-source LLM app development platform with an intuitive interface that combines AI workflow, RAG pipeline, agent capabilities, model management, and observability features for rapid prototyping and production deployment.

Knowledge engine for AI agent memory and memory layer for AI agents. Replaces complex RAG pipelines with serverless, single-file memory supporting instant retrieval and long-term memory.

LEANN is a lightweight RAG-focused library for vector search on embeddings, achieving 97% storage savings via advanced compression and quantization techniques on personal devices. Implemented in Rust/Python, it supports efficient ANN indexing without full DB overhead. Ideal for embedded apps and private prototyping; far lighter than Milvus, more efficient on-device vs hnswlib.

ClickHouse is a columnar OLAP database with vector indexes (ANN via AMM, brute-force), supporting SQL queries over vectors + structured data at petabyte scale. Excels in aggregations with vectors. For analytics workloads with embeddings; faster ingestion than Postgres pgvector for big data.