Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up
mistralai 's Collections
Devstral 2
Mistral Large 3
Ministral 3
Ministral 3 - Additional Checkpoints
Speech Evals

Speech Evals

updated Nov 28, 2025

Synthesized speech evals generated by MistralAI from popular text evaluation datasets to evaluate spoken-language reasoning capabilities of Audio LLMs

Upvote
12

  • mistralai/mmlu_speech

    Viewer • Updated Jul 15, 2025 • 14.3k • 367 • 14

  • mistralai/triviaqa_speech

    Viewer • Updated Jul 15, 2025 • 17.9k • 117 • 6

  • mistralai/gsm8k_speech

    Viewer • Updated Jul 15, 2025 • 1.32k • 77 • 6
Upvote
12
  • Collection guide
  • Browse collections
Company
TOS Privacy About Careers
Website
Models Datasets Spaces Pricing Docs