tech
Introducing Agentic Search
Mistral Agentic Search delivers more accurate search results while reducing turns, token use, and latency against FinanceBench and OfficeQA Pro benchmarks. Agentic Search is the retrieval layer that enables AI systems to navigate, read, and verify information inside even the most complex documents. Available through Mistral Search Toolkit and Libraries.
TL;DR
- Agentic Search enables AI systems to navigate, read, and verify information in complex documents.
- It improves search results by allowing models to search beyond retrieved chunks and inspect data within long or multiple documents.
- Agentic Search offers support for sensitive, domain-specific data without compromising isolation boundaries.
- Accuracy improvements are substantial, with up to 3x correctness on financial filings (FinanceBench) and a +45.6 point gain on table-heavy questions (OfficeQA Pro).
- Latency is reduced by up to 39.6%, and token consumption is decreased by up to one-third due to targeted navigation and fewer repeated searches.
- The system utilizes five tools: search, open, navigate, read, and grep, which do not require fine-tuning.
- Traditional RAG (Retrieval-Augmented Generation) falls short due to its one-shot retrieval, chunk-level limits, and lack of iteration.
- Agentic Search is model-agnostic and improves as models get better at reasoning and tool use.
- It is particularly useful for long documents, questions across multiple sources, answers requiring verification, and tables/structured documents.
- Mistral Agentic Search is available through the Mistral Search Toolkit and Libraries, with starter apps and documentation for getting started.