tech
Mistral batch API
This could've been a tweet, but... While the AI developer community was faced with several API price hikes in the past few weeks, we’re trying to make sure to continue bringing frontier AI to you at affordable price points. To that end, we’re introducing the batch API, available today on La Plateforme.
TL;DR
- Mistral AI introduces a batch API on La Plateforme.
- The batch API offers AI model processing at 50% lower cost than synchronous API calls.
- It is ideal for high-volume data processing where real-time responses are not critical.
- Users upload a batch file, and download the processed output.
- Popular applications include sentiment analysis, bulk summarization, translation, vector embedding, and data labeling.
- The API is available for all models on La Plateforme and will be available via cloud partners soon.
- Usage is limited to 1 million ongoing requests per workspace.