AI Tools.

Search
audio text to text by microsoft

VibeVoice-ASR-HF

VibeVoice-ASR is Microsoft's HuggingFace-packaged automatic speech recognition model, likely a Whisper-style or custom encoder-decoder ASR system targeting informal or conversational speech. The 'Vibe' branding suggests orientation toward natural conversational audio.

Summary text generated by an automated pipeline from the model card · Not individually reviewed or run by us · How this page is made

Share: X Reddit HN LinkedIn

From the model card

Fields below are copied from the tags and counters on the HuggingFace repository microsoft/VibeVoice-ASR-HF at our last fetch. They are set by the uploader, not verified by us; rows with no tag are omitted. How this page is made.

Publisher (HF namespace)
microsoft
Pipeline tag
audio-text-to-text
Library
Transformers
Weight formats
safetensors
License tag
mit — read the license file in the repo before relying on it
Language tags
English (en), Chinese (zh), Spanish (es), Portuguese (pt), German (de), Japanese (ja), Korean (ko), French (fr), Russian (ru), Indonesian (id), Swedish (sv), Italian (it), Hebrew (he), Dutch (nl), Polish (pl), Norwegian (no), Turkish (tr), Thai (th), Arabic (ar), Hungarian (hu), Catalan (ca), Czech (cs), Danish (da), Persian (fa), Afrikaans (af), Hindi (hi), Finnish (fi), Estonian (et), Afar (aa), Greek (el), Romanian (ro), Vietnamese (vi), Bulgarian (bg), Icelandic (is), Slovenian (sl), Slovak (sk), Lithuanian (lt), Swahili (sw), Ukrainian (uk), Kalaallisut (kl), Latvian (lv), Croatian (hr), Nepali (ne), Serbian (sr), Filipino (tl), Yiddish (yi), Malay (ms), Urdu (ur), Mongolian (mn), Armenian (hy), Javanese (jv)
Papers cited
arXiv:2601.18184
Downloads (HF counter at last fetch)
528,090
Likes (HF counter at last fetch)
157
Model card
https://huggingface.co/microsoft/VibeVoice-ASR-HF

Use cases

  • Transcription of conversational and informal speech
  • Meeting transcription in Microsoft productivity tool integrations
  • ASR in noise-robust scenarios where formal speech assumptions fail
  • Voice input for enterprise applications using HuggingFace pipelines

Pros

  • Microsoft-maintained with enterprise-grade reliability expectations
  • HuggingFace packaging makes it drop-in compatible with transformers ASR pipelines
  • Conversational speech focus useful for real-world audio (not just read speech)

Cons

  • Microsoft license terms apply — verify commercial use permissions
  • Less community-benchmarked than Whisper on standard ASR test sets
  • Model card lacks detailed WER benchmarks across accent and noise conditions
  • May require specific Microsoft ecosystem integration for optimal performance

Tags

transformerssafetensorsASRDiarizationSpeech-to-TextTranscriptionaudio-text-to-textenzhesptdejakofrruidsvithe