Antfly
Distributed Hybrid Search Engine for the GPT Era
Antfly is a distributed hybrid search engine released by the Antfly DB team in March 2026. Just as GPT can understand any text, Antfly enables indexing and searching any type of data, including text, images, audio, and video, within a single engine. It is built on top of etcd's Raft consensus algorithm and CockroachDB's Pebble storage engine, and its core identity lies in hybrid search, which merges BM25 full-text search, dense vector similarity, and graph traversal into a single query. As suggested by its homepage slogan, "Self-learning Retrieval for Agents," it is designed to enable AI agents to find the precise needle in a vast haystack of data. Previously, implementing vector search required combining multiple systems, such as external APIs for embedding generation (e.g., OpenAI, Cohere), Elasticsearch for full-text search, and Neo4j for knowledge graphs, leading to multi-infrastructure complexity. Antfly integrates these three components into a single binary. Through its built-in inference engine, it can handle embedding generation, document chunking, and cross-encoder reranking locally, without requiring external API calls. Its multi-Raft architecture separates the metadata consensus group and the shard-specific storage consensus group, providing fault isolation, ensuring that a failure in a specific shard does not propagate to the entire cluster. It applies RaBitQ quantization to SPANN-based vector indexing and supports the HTTP/3 (QUIC) protocol, maintaining low latency even with large datasets. In life science research, Antfly is suitable for integrating heterogeneous data sources, such as papers, patents, clinical documents, and microscopic images, into a single search infrastructure. For example, PubMed paper text and pathology tissue images can be loaded into the same collection, and then text and images can be simultaneously hybrid searched using a natural language query such as "lung tissue patterns associated with EGFR mutations." By leveraging its built-in RAG agent functionality, search results can be automatically passed to an LLM for summarization, inference, and streaming of follow-up questions. Furthermore, a knowledge graph pipeline can be built to automatically extract and explore relationships between genes, diseases, and drugs through graph indexing, without requiring separate infrastructure. It seamlessly integrates with existing SQL workflows through a PostgreSQL extension (pgaf) and facilitates integration with the AI agent ecosystem through MCP server and A2A protocol support.
π» System Requirements
GPU not required β the built-in inference engine supports CPU-based embedding generation. When using a GPU, integration with external embedding providers such as Ollama is possible.
Minimum 20GB (Swarm mode), scale proportionally to the dataset size.
β‘ Installation
### 4-1. Quick Start
```bash
# macOS (Homebrew)
brew install antflydb/taps/antfly
# Linux / Generic (Installation Script)
curl -fsSL https://releases.antfly.io/antfly/latest/install.sh | sh
# Docker
docker run -p 8080:8080 ghcr.io/antflydb/antfly:omni
```
### 4-2. Detailed Installation
```bash
# 1. Verify the version after installation
antfly --version
# 2. Start the embedding model pool and Swarm mode
antfly swarm
# 3. Create a table (including embedding index)
antfly table create --table my_docs \
--index '{"type":"embeddings","embedder":{"provider":"termite","model":"BAAI/bge-small-en-v1.5"},"chunker":{"target_tokens":200,"overlap_tokens":25}}'
# 4. Load data
antfly load --table my_docs --file documents.json --id-field id
# 5. Perform hybrid search
antfly query --table my_docs \
--full-text-search 'body:"target gene"' \
--semantic-search "cancer biomarker discovery" \
--limit 10
# 6. Access the web dashboard
# http://localhost:8080 (Antfarm Dashboard)
```𧬠Bio Use Cases
π¬ Multimodal Search for Bio Papers and Pathology Images
Load 100,000 PubMed papers and tissue pathology images into the same collection, and perform text+image simultaneous searches such as "BRCA1 mutant breast cancer tissue" using CLIP embedding and BM25 hybrid search. Improve the precision of the top 10 results with cross-encoder re-ranking, reducing the time for literature research to discover new drug targets from several days to several minutes.
𧬠Automatic Construction of Gene-Disease-Drug Knowledge Graph
Load DrugBank, OMIM, and other public databases into the Antfly graph index, and explore geneβdiseaseβdrug pathways with automatic relationship extraction. Perform multidimensional search combining graph queries such as "All approved drugs and clinical trial status related to TP53" with BM25+vector filters.
π₯ Clinical Trial Regulatory Document RAG Pipeline
Chunk FDA guidance, ICH guidelines, and clinical trial protocol documents with target_tokens=200, and instantly check for streaming responses such as "Examples of biomarker-driven enrichment strategies in Phase III trials" using the built-in RAG agent. Automate the workflow for reviewing regulatory documents and preparing for submission.
π Update Notes
No update notes yet.
π§ͺ Related Code of Life
No related Code of Life posts yet.