llm-app

AnythingLLM is an open-source, self-hosted AI application with integrated vector storage and retrieval for embeddings, enabling RAG and LLM workflows. Key features include built-in RAG, AI agent support, Docker deployment, and free MIT license. Ideal for RAG prototypes and local deployments, providing cost savings and full control compared to managed services like Pinecone.

Apache Arrow is an open-source, self-hosted columnar in-memory data platform for efficient vector data interchange and processing in AI applications. Key features include zero-copy reads, multi-language libraries, and Apache 2.0 license for free use. Used for high-performance data loading in RAG pipelines and ML workflows, offering cost-free scalability vs proprietary formats.

Awesome-Moviate is an open-source, self-hosted demo for hybrid vector search using Weaviate, combining BM25 and semantic search for movie recommendations. Key features include Docker deployment, hybrid retrieval pipeline, and free open-source code. Ideal for RAG-like prototypes in media retrieval, self-hosted for cost-effective experimentation vs managed vector DBs like Pinecone.

Bleve is an open-source, self-hosted full-text search and indexing library in Go with experimental vector search support for hybrid retrieval. Key features include full-text, numeric, geo-spatial indexing, flexible mappings, and free Apache 2.0 license. Suitable for RAG prototypes needing hybrid search, offering self-hosted cost savings vs managed services like Pinecone.

Crate is an open-source, self-hosted distributed SQL database with native vector data types and similarity search for AI applications. Key features include horizontal scaling, PostgreSQL compatibility, Lucene-based indexing, and Apache 2.0 license. Ideal for RAG and real-time analytics, providing free self-hosting vs managed vector DBs like Pinecone for cost control.

frugal is an open-source, self-hosted platform for AI/ML operations with vector database support, focusing on cost optimization and transparency. Key features include model-agnostic tracking, alerting, caching, and free use. Useful for RAG prototypes monitoring costs, self-hosted alternative to managed services like Pinecone for reduced expenses.