arrow_back Back to AIFC
S
pending Claude

RedNote Open-Sources dots.tts: A 2B-Parameter, Fully Continuous TTS Foundation Model

Grounded / Real Inflated / Uruttu
95% real
5% uruttu
article Original Content
RedNote’s Dots Studio team has fully open-sourced dots.tts, a 2B-parameter, fully continuous, end-to-end autoregressive text-to-speech foundation model.
Unlike mainstream TTS systems that generate discrete acoustic tokens, dots.tts models speech directly in a continuous latent space, bringing together high-fidelity zero-shot voice cloning, multilingual speech synthesis, expressive generation, and real-time streaming.
🌟 Key Highlights:
🌊 Fully continuous autoregressive architecture
dots.tts removes discrete acoustic tokens from the speech-generation pipeline. It combines a 48 kHz AudioVAE, a semantic encoder, an LLM, and an autoregressive flow-matching acoustic head to generate speech one continuous latent patch at a time.
🧠 Improved long-range consistency
Full-history conditioning allows the acoustic head to use the complete generated prefix, while reward-free self-corrective post-training exposes the model to its own inference-time errors. Together, these designs help reduce drift and improve robustness during long autoregressive generation.
⚡ Ultra-low-latency dual streaming
CFG-aware MeanFlow distillation reduces acoustic generation to only 2–4 function evaluations, achieving first-packet latencies of 85 ms in output-streaming mode and 54 ms in dual-streaming mode, making the model suitable for real-time conversational applications.
🌍 Strong multilingual voice cloning and expressiveness
Trained on 1.5 million hours of multilingual speech, dots.tts has been evaluated across 24 languages and demonstrates strong multilingual and cross-lingual voice cloning, as well as expressive speech generation.
🏆 Open-source state-of-the-art performance
dots.tts achieves strong results on major TTS benchmarks. The release includes pretrained, post-trained SOAR, and MeanFlow-distilled checkpoints, together with training, inference, and fine-tuning code under the Apache 2.0 license.
🚀 Get started:
👉 GitHub: https://lnkd.in/ecSN2-t8
👉 Hugging Face Models: https://lnkd.in/euBvdAcv
👉 Online Demo: https://lnkd.in/egcVMBfw
👉 Paper: https://lnkd.in/eqHWx-gx
verified Validated Content

Excellent — this one checks out almost entirely against the actual technical report and repo. Here's the detail:

Confirmed accurate:

  • Developer/attribution: dots.tts is from RedNote's Hilab (rednote-hilab) team — matches "RedNote's Dots Studio team" (the GitHub org is also mirrored as studio-dots-ai).
  • 2B parameters, fully continuous, end-to-end autoregressive TTS foundation model — confirmed exactly.
  • Continuous latent space vs. discrete acoustic tokens — confirmed as the model's core design differentiator.
  • 48 kHz AudioVAE + semantic encoder + LLM + autoregressive flow-matching acoustic head — confirmed; the LLM backbone is specifically Qwen2.5-1.5B-Base.
  • Full-history conditioning + reward-free self-corrective post-training — confirmed, this matches the paper's "Self-corrective Alignment (SCA)," described as reward-free and flow-matching-native.
  • CFG-aware MeanFlow distillation → 2–4 function evaluations — confirmed, directly from the technical report.
  • First-packet latencies: 85 ms (output-streaming) / 54 ms (dual-streaming) — confirmed exactly, word-for-word match to the paper: "85 ms at RTF 0.231 in plain mode and 54 ms at RTF 0.245 in interleaved streaming mode."
  • 1.5 million hours of multilingual training speech — confirmed exactly.
  • Evaluated across 24 languages — confirmed exactly; this is the MiniMax-Speech multilingual benchmark, which the paper explicitly evaluates on all 24 languages.
  • Apache 2.0 license, with pretrained (base), post-trained (soar/SCA), and MeanFlow-distilled (mf) checkpoints, plus training/inference/fine-tuning code — confirmed exactly, matches the three released checkpoints (dots.tts-base, dots.tts-soar, dots.tts-mf).
  • State-of-the-art open-source benchmark performance — supported: leads average speaker similarity (83.9) on the 24-language benchmark, strong Seed-TTS-Eval numbers, competitive on EmergentTTS-Eval and CV3-Eval.

One thing to flag:

  • A separate marketing page (scriptbyai.com) advertises dots.tts as supporting "100+ languages," which conflicts with the paper's own evaluation scope of 24 languages. Your post's "24 languages" figure is the one that matches the primary source (the technical report), so it's the more accurate number to use — just be aware other secondary write-ups are inflating this figure.
  • Minor real-world caveat: at least one early user on social media disputed the 54ms latency figure as unrealistic in their own testing — worth knowing that the number is the paper's benchmark condition (specific hardware, RTF), not a universal guarantee across all setups.

Links: the GitHub, Hugging Face, demo, and paper links are all lnkd.in redirects I can't resolve directly, but everything they're pointing to (GitHub repo rednote-hilab/dots.tts, HF orgs rednote-hilab/dots-studio, and the arXiv paper) does genuinely exist and matches the post's claims.

Bottom line: this is the most accurate of all the posts you've had me check — nearly every specific technical figure traces directly back to the model's own technical report with no discrepancies.