AI Tools.

Search
text to speech by fishaudio

s2-pro

s2-pro is Fish Audio's multilingual text-to-speech model supporting over 80 languages with instruction-following capabilities, described in arXiv:2603.08823. It is designed for zero-shot voice cloning and cross-lingual synthesis by conditioning on speaker reference audio and natural language prompts. The license is marked 'other', meaning specific usage restrictions apply beyond standard open-source terms.

Summary text generated by an automated pipeline from the model card · Not individually reviewed or run by us · How this page is made

Share: X Reddit HN LinkedIn

From the model card

Fields below are copied from the tags and counters on the HuggingFace repository fishaudio/s2-pro at our last fetch. They are set by the uploader, not verified by us; rows with no tag are omitted. How this page is made.

Publisher (HF namespace)
fishaudio
Pipeline tag
text-to-speech
Weight formats
safetensors
License tag
other — read the license file in the repo before relying on it
Language tags
multilingual; Chinese (zh), English (en), Japanese (ja), Korean (ko), Spanish (es), Portuguese (pt), Arabic (ar), Russian (ru), French (fr), German (de), Swedish (sv), Italian (it), Turkish (tr), Norwegian (no), Dutch (nl), Welsh (cy), Basque (eu), Catalan (ca), Danish (da), Galician (gl), Tamil (ta), Hungarian (hu), Finnish (fi), Polish (pl), Estonian (et), Hindi (hi), Latin (la), Urdu (ur), Thai (th), Vietnamese (vi), Javanese (jw), Bangla (bn), Yoruba (yo), Slovenian (sl), Czech (cs), Swahili (sw), Norwegian Nynorsk (nn), Hebrew (he), Malay (ms), Ukrainian (uk), Indonesian (id), Kazakh (kk), Bulgarian (bg), Latvian (lv), Burmese (my), Filipino (tl), Slovak (sk), Nepali (ne), Persian (fa), Afrikaans (af), Greek (el), Tibetan (bo), Croatian (hr), Romanian (ro), Shona (sn), Māori (mi), Yiddish (yi), Amharic (am), Belarusian (be), Khmer (km), Icelandic (is), Azerbaijani (az), Sindhi (sd), Breton (br), Albanian (sq), Pashto (ps), Mongolian (mn), Haitian Creole (ht), Malayalam (ml), Serbian (sr), Sanskrit (sa), Telugu (te), Georgian (ka), Bosnian (bs), Punjabi (pa), Lithuanian (lt), Kannada (kn), Sinhala (si), Armenian (hy), Marathi (mr), Assamese (as), Gujarati (gu), Faroese (fo)
Papers cited
arXiv:2603.08823
Downloads (HF counter at last fetch)
414,738
Likes (HF counter at last fetch)
1,280
Model card
https://huggingface.co/fishaudio/s2-pro

Use cases

  • Zero-shot voice cloning from a short reference audio clip
  • Generating multilingual narration from a single speaker profile
  • Producing dubbed audio for video content across 80+ languages
  • Building TTS pipelines that accept natural language speaking style instructions
  • Research into cross-lingual speaker transfer and prosody control

Pros

  • Supports over 80 languages including low-resource ones like Tibetan, Yoruba, and Maori
  • Instruction-following capability allows controlling speaking rate, emotion, and style via text prompts
  • Zero-shot speaker cloning reduces the need for per-speaker fine-tuning
  • High community interest with 1052 likes, indicating active user validation
  • safetensors format enables safer and faster model loading

Cons

  • Non-standard license ('other') requires careful review before commercial or redistribution use
  • Quality across 80+ languages is uneven; low-resource language outputs are typically less natural than major languages
  • Zero-shot cloning fidelity degrades with short or noisy reference audio
  • No published ablation across language subsets makes it difficult to predict per-language performance
  • Instruction-following behavior may be inconsistent for complex or conflicting style prompts

Tags

safetensorsfish_qwen3_omnitext-to-speechinstruction-followingmultilingualzhenjakoesptarrufrdesvittrnonl