WritingMistral AIMistral AIpublished Oct 20, 2026seen 4d

Captured source

source ↗
published Oct 20, 2026seen 4dcaptured 4dhttp 200method plain

Voxtral 3: Voice Agent SDK & Speech Models in 50+ Languages

Agent

Sure. What's the reference number?

Tool call

get_referral(ref="4420 1187")

Result

Merci de recevoir ce patient pour un avis dermatologique. Traitement en cours : crème à l’hydrocortisone. Dr Martin, Clinique du Parc.

Agent

It says, "Merci de recevoir ce patient pour un avis dermatologique." Your doctor is asking a dermatologist, Dr Martin, to see you. The next slot is Tuesday at 5:45 pm. Shall I book it?

Tool call

book_appointment(slot="Nov 3 17:45")

Result

confirmed

Agent

Done. Bring the letter, your carte Vitale, and I'll text you the details in English.

Voxtral

3

Take the call

Béatrice

Hi, my doctor gave me a referral letter in French. Can you book it for me?

Béatrice

4402... sorry, 4420 1187.

Béatrice

Yes, please.

Thinking Summary

Voxtral 3 introduces a cutting-edge voice agent SDK and state-of-the-art speech models designed for real-time, multi-step conversations across 50+ languages. It combines accurate transcription, natural speech synthesis with emotional adaptability, and deep tool integration for seamless workflow automation. Available via Mistral’s EU-hosted API or self-deployment, it ensures data sovereignty while delivering low-latency, human-like interactions for contact centers, virtual assistants, and hands-free copilots.

Speech transcription and voice generation have come a long way, but building end-to-end voice agents that can listen, reason, interact, and handle complex workflows remains difficult. A reliable voice agent needs to do four things very well (and simultaneously): Listen accurately across languages, accents, speakers, and interruptions,

Reason deeply about what users mean in specific contexts,

Speak naturally with emotion and expression, and

Take action over multiple steps through connected systems.

Getting all four to work together reliably in real time remains a challenge. To address this, we introduce Voxtral 3: a new family of state-of-the-art speech-to-text and text-to-speech models, alongside a voice agent SDK that brings listening, thinking, tool calling, and speaking into a single real-time streaming pipeline. Voxtral 3 is built to create natural conversational experiences, from contact-center agents and service desks to virtual assistants and hands-free copilots. With support for dozens of languages, expressive speech, complex reasoning, and deep integration with your own tools and data, agents built with Voxtral can interpret nuanced intent, reason through sophisticated requests, and execute multi-step actions across connected systems. As with other Mistral models, the Voxtral 3 family is designed for sovereign deployment. Available today through Mistral's EU-hosted API or for self-deployment on your own infrastructure, it gives organizations control over where audio is processed, how data is handled, and whether conversations are retained.

Highlights Accurate transcription across 50+ languages . The speech-to-text model, Voxtral Small Transcribe 3 , is state-of-the-art in multilingual transcription, identifying who said what (diarization), using keyphrases to improve its accuracy (context-biasing). It detects when someone has finished speaking so agents can respond without delay (end-of-turn detection).

Natural speech that adapts to the conversation . The text-to-speech model, Voxtral Mini TTS 3 , introduces new voices that adjust their emotion, pace, and emphasis based on conversational context, with support for 35+ languages and 50+ dialects.

Human-like intelligence at your (spoken) command . The new voice agent SDK combines listening, reasoning, tool calling, and speaking into a real-time experience. Agents can retrieve information, interact with business systems, and complete tasks during live conversations over phone or web.

Pro Voice for distinctly accurate voice adaptation . For professional use cases where basic voice cloning does not suffice, Voxtral’s Pro Voice adaptation is able to reproduce a speaker’s distinctive character, emotional range, and speaking style across languages, using just 30 minutes of audio.

Your voice AI, on your infrastructure . Use Mistral's EU-hosted API or deploy Voxtral 3 on your own infrastructure. Keep sensitive conversations within your environment and control whether any audio is retained.

Try Voxtral now  | Learn more It hears 50+ languages, with state-of-the-art accuracy. Voxtral Transcribe 3 represents a significant milestone across transcription, diarization (who spoke when) and context biasing capabilities. The supported list of languages is expanded to 50, including 24 official EU languages and many low-resource Asian and Indic languages. The Small version achieves state-of-the-art results across diarization and multilingual transcription, including in English, French and Spanish. It outperforms Whisper, Scribe v2 and Gemini 3.5 Transcribe. The Mini variant is 4B parameters, enabling fast and accurate transcriptions at a price of $0.0035/min. Both models support context biasing, where key terms and free-form text can be given to bias the transcription and improve recall on technical terms. This enables them to be used in production settings with domain-specific vocabulary without the need for fine-tuning. Multilingual Transcription

Diarization

Context Bias

Artificial Analysis

FLEURS 45 Forced vs Inferred Word Error Rate — lower is better

Download PNG Download SVG

Forced

Inferred

4.1% 4.0% 4.1% 4.0% 4.6% 4.5% 6.1% 4.5% 4.9% 4.9% 6.3% 5.6% 16.0% 14.9% Voxtral Small Transcribe 3 Microsoft AI Transcribe 2 Voxtral Mini Transcribe 3 Gemini 3.5 Transcribe Scribe v2 GPT Transcribe Whisper large-v3 2.0% 4.0% 6.0% 8.0% 10.0% 12.0% 14.0% 16.0% Word Error Rate

Macro-average WER over the intersection of 45 languages in the FLEURS benchmark supported by all seven models. WER is used for all languages except Japanese, Korean, Thai, and Chinese, which use CER. Lower is better. Forced = language specified; Inferred = language auto-detected. Languages: AR, BN, BG, CA, ZH, CS, DA, NL, EN, ET, FI, FR, DE, EL, GU, HI, HU, IS, ID, IT, JA, KN, KO, LV, LT, MK, MS, ML, MR, NO, FA, PL, PT, RO, RU, SK, SL, ES, SV, FIL, TE, TH, TR, UK, VI

Diarization Concatenated Minimum Permutation WER — lower is better

Download PNG Download SVG

18.4% 18.6% 19.0% 20.3% 23.0% 30.9% 38.4% Voxtral Small Transcribe 3 Voxtral Mini Transcribe 3 Pyannote Orchestrator (Precision 3) Microsoft AI Transcribe 2 Scribe v2 Voxtral...

Excerpt shown — open the source for the full document.

Notability

notability 7.0/10

Notable model release by Mistral