Chroma vs Milvus

Chroma is open-source infrastructure for storing embeddings and metadata, then searching and retrieving information across text, images, and other modalities. Search options include dense, sparse, and hybrid vector search, plus full-text and regex search and metadata filtering. It can run locally through pip, npm, or Docker, on Chroma Cloud, or in a customer’s own VPC. The maker says its Apache 2.0-licensed codebase powers both the open-source database and Chroma Cloud. Documented integrations include embedding providers such as OpenAI, Cohere, Google Gemini, Hugging Face, Jina AI, and Ollama, and frameworks such as LangChain, LlamaIndex, Haystack, Streamlit, and DeepEval. Cloud security features include encryption in transit and at rest, SSO, role-based access control, and employee MFA; Chroma Cloud has completed a SOC 2 Type II examination. Starter is free, with 10 databases and 10 team members. Team is $250 a month plus usage and includes $100 credits, 100 databases, and 30 team members.

Milvus is an open-source vector database from Zilliz for GenAI and scalable vector search. It supports approximate-nearest-neighbor, filtered, range, hybrid, and full-text search, along with reranking, fetch, and query operations. Metadata filtering, sparse vectors, and index types including HNSW, IVF, FLAT, DiskANN, and SCANN are documented. Deployment choices are Milvus Lite as a Python library, Standalone as a single-machine server, and Distributed on Kubernetes. Documentation recommends Lite for up to a few million vectors, Standalone up to 100 million, and Distributed for 100 million to tens of billions. Lite can run locally without a cloud service for private or sensitive data; an online upgrade from Standalone to a cluster is not currently supported. Official interfaces include REST plus Python, Go, Java, Node.js, and C++ APIs or SDKs. C# is contributed by Microsoft and Rust is under development. Security documentation covers authentication, TLS for gRPC and REST, and role-based access control at collection, database, and instance levels. The Apache 2.0 software is free, and Zilliz Cloud is offered as a managed option.