SmollerTTS, a 2.81M-parameter English TTS model

SmollerTTS is a 2.81M-parameter English voice that runs on your browser’s CPU. The weights take up 11.34 MB. Try it below.

Loading the voice, about 30 MB…

Starting small

I originally wanted a model under a million parameters that spoke several languages. The early versions sounded robotic and skipped words. I kept changing things, but it was hard to tell whether pronunciation, the acoustic model or the waveform decoder was responsible.

I narrowed it to one English speaker and a pretrained HiFi-GAN V2 vocoder. That made debugging easier. I could compare audio reconstructed from a real recording with audio made from my model’s predictions. The vocoder was the same in both, so the difference pointed back to the acoustic model.

The result is my own 1.88M-parameter acoustic network, trained from scratch on LJSpeech, paired with a 0.93M-parameter vocoder. Both run locally; your text stays on your device.

From text to a waveform

Text becomes phonemes, the model predicts their timing and acoustic features, and the vocoder turns those features into audio. Each chunk of speech is predicted in parallel.

View full architecture
SmollerTTS architecture: four text encoder blocks feed duration prediction and length regulation, six frame blocks predict 80 mel bands, and a HiFi-GAN V2 vocoder produces a 22.05 kHz waveform.

Text and pronunciation

The frontend expands dates, times and money into words before converting them to phonemes. “$12.99” needs a spoken reading such as “twelve dollars and ninety-nine cents.” Stress markers tell the model which syllables should receive emphasis.

This was one place where an apparently simple fix backfired. Splitting difficult words into familiar pieces helped some examples but made ordinary words worse. The current frontend keeps dictionary pronunciations, only splits tested compounds automatically, and lets you supply an explicit pronunciation when needed.

Timing and acoustic features

Phoneme and stress embeddings are summed at a width of 160, with positional encoding added. Four encoder blocks combine four-head self-attention, depthwise convolutions and small feed-forward layers. Attention gives each phone context from the sentence; the convolutions capture local patterns.

A duration head predicts how many frames each phone should occupy. The length regulator repeats the N encoded phones in H by their predicted durations, giving T audio frames in total. A position signal within each phone lets its beginning and ending sound different.

H~=LR⁡(H,d^),T=∑i=1Nd^i\widetilde{H}=\operatorname{LR}(H,\widehat{d}), \qquad T=\sum_{i=1}^{N}\widehat{d}_i

Six convolutional frame blocks then predict an 80-band mel spectrogram, a compact description of how sound energy changes over time. Pitch, voicing and energy predictions condition this stage. The acoustic network contains 1,882,807 parameters.

Each frame block uses a depthwise convolution to mix nearby frames, followed by two linear layers that expand the features from 160 to 320 channels and bring them back to 160.

U=LN⁡ ⁣(DWConv⁡(X)),V=W2 ⁣(GELU⁡ ⁣(W1(U))),Xout=X+α⊙V.\begin{aligned}U&=\operatorname{LN}\!\left(\operatorname{DWConv}(X)\right),\\V&=W_2\!\left(\operatorname{GELU}\!\left(W_1(U)\right)\right),\\X_{\mathrm{out}}&=X+\alpha\odot V.\end{aligned}

Here, X is the input frame sequence, LN is layer normalization, and W₁ and W₂ are learned linear layers including their biases. The learned channel-wise scale α controls how much the block adds to its input. Padding masks are omitted from the equation.

The waveform decoder

The frozen HiFi-GAN LJ_V2 generator converts those mel features into a 22,050 Hz mono waveform. Its four upsampling stages expand each frame by 8 × 8 × 2 × 2, or 256 audio samples. Residual branches with different receptive fields help model the waveform at several scales.

I use the published vocoder weights, which contribute 925,985 parameters. Its training discriminators are not needed for playback. Together, the acoustic model and vocoder total 2,808,792 parameters.

The acoustic model learns normalized mel features. Before sending its predictions to HiFi-GAN, I restore their original scale using statistics calculated from the training set.

Zt,f=Mt,f−μfσf,M^t,f=σfZ^t,f+μf,x^=GHiFi-GAN(M^).\begin{aligned}Z_{t,f}&=\frac{M_{t,f}-\mu_f}{\sigma_f},\\\widehat{M}_{t,f}&=\sigma_f\widehat{Z}_{t,f}+\mu_f,\\\widehat{x}&=G_{\mathrm{HiFi\text{-}GAN}}(\widehat{M}).\end{aligned}

M contains the log-mel features and Z their normalized values. The indices t and f identify a frame and mel band; μ and σ are the per-band training mean and standard deviation. Hats mark predictions, and x̂ is the generated waveform.

Training the acoustic model

I used LJSpeech, roughly 24 hours of recordings from one English speaker. The released run used 12,134 accepted training clips, about 22.12 hours, with separate development recordings and reserved test IDs. A single speaker kept the voice consistent without needing a speaker-conditioning system.

Forced alignment estimates where each phoneme occurs in the recordings, giving the model a duration target. WORLD extracts pitch and voicing. The preparation code computes energy and mel features, then calculates normalization statistics from training frames only.

The mel features have to match what the vocoder was trained to consume. That includes the magnitude convention, frequency range, window, hop, padding and log scale. Getting the tensor shape right is not enough. I also compare the exported graphs with the Python model to catch changes introduced on the way to the browser.

The acoustic model starts from random weights. The release recipe uses 10,000 updates with AdamW, complete utterances and a learning-rate warm-up. The loss combines mel reconstruction, changes between neighbouring mel frames, phoneme duration and prosody prediction. The frozen vocoder does not participate in this training loop.

Training settings

InitializationRandom; seed 2718
BatchUp to 24 utterances; 12,000 padded frames
OptimizerAdamW; β = (0.9, 0.98); weight decay 0.01
Learning rate5 × 10⁻⁴ base; 300-step warm-up; 20,000-step half-life
Mel features80 bands; FFT 1024; hop 256; 0–8,000 Hz
PrecisionFP32; TF32 enabled on CUDA
L=Lmel+0.5LΔmel+0.5Lduration+0.15Lframe prosody+0.1Lphone prosody\begin{aligned}\mathcal{L}={}&\mathcal{L}_{\mathrm{mel}}+0.5\mathcal{L}_{\Delta\mathrm{mel}}+0.5\mathcal{L}_{\mathrm{duration}}\\&+0.15\mathcal{L}_{\mathrm{frame\ prosody}}+0.1\mathcal{L}_{\mathrm{phone\ prosody}}\end{aligned}

The loss uses absolute error for mel reconstruction, frame-to-frame differences for the delta term, and squared error on log durations. Prosody combines pitch, energy and voicing. The full configuration is in the repository.

I still want to address a mismatch between training and inference. The decoder receives recorded prosody during training and predicted prosody when generating speech. Training it to cope with its own imperfect predictions is one of the next experiments I want to run.

Getting it into the browser

The model is exported as three FP32 ONNX graphs for the encoder, frame decoder and vocoder. JavaScript handles text processing and length regulation between them. A Web Worker runs inference on a single WebAssembly CPU thread, keeping the page responsive while audio is generated.

GraphFile sizeJob
Encoder5.00 MBPhones, durations, coarse prosody
Frame decoder2.59 MBFrame features and mel prediction
Vocoder3.74 MBMel features to waveform
Total weights11.34 MB2.81M parameters, FP32

Including the runtime and pronunciation files, the download is about 30 MB. The weights are FP32, with no quantization yet. I checked the exported model against the Python version to catch differences in the browser output.

The full demo plays longer text in chunks, starting as soon as the first is ready. This article’s player waits for the complete output. Repeated requests can reuse cached audio.

Speech quality vs. model size (rough)

I scored SmollerTTS on the four English prompts used by tts-bench and added it to their published results.

SmollerTTSUnder 10M10–100M100M+
UTMOS
Parameters · log scale
85 results Sources
RuntimeSource
AuroraTTS-100K95.6K3.0911.58%Linux CPU
sanoTTS Amy1.46M3.826.69%Linux CPU
SmollerTTS2.81M3.556.69%Browser CPU
Inflect-Nano v23.96M4.435.30%Linux CPU
tiny-voca4.50M4.406.57%Linux CPU
Vaniq-Edge8.91M4.279.34%Linux CPU
Inflect-Micro v29.36M4.443.03%Linux CPU
KittenTTS Nano 0.815.00M4.294.42%Linux CPU
Piper15.00M4.314.42%Linux CPU
SteerTTS (no refiner)23.10M3.956.49%Linux CPU
Underdog Woof38.20M4.458.96%Linux CPU
SteerTTS40.80M4.086.49%Linux CPU
LinnetTTS41.40M4.188.84%Linux CPU
SupraTTS 0.1 Beta43.50M3.305.81%Linux CPU
MeloTTS52.00M3.7615.20%Linux CPU
ribt54.00M4.257.20%Linux CPU
Soprano 1.1 80M80.00M4.035.18%Linux CPU
Kokoro82.00M4.508.08%Linux CPU
Hojo-TTS-Light 40M84.50M4.3611.87%Linux CPU
Supertonic 399.00M4.467.45%Linux CPU
MOSS-TTS-Nano100.00M4.105.93%Linux CPU
OpenVoice v2100.00M4.1013.73%Linux CPU
Pocket-TTS v4100.00M4.335.30%Linux CPU
Sopro V2 Turbo120.00M4.008.01%Linux CPU
Sopro V2 Turbo (streaming)120.00M3.647.45%Linux CPU
LuxTTS123.00M2.3061.10%Linux CPU
ZipVoice123.00M4.017.20%Linux CPU
Scylla's Band131.00M4.162.90%Linux CPU
StyleTTS 2148.00M4.3717.66%Linux CPU
Hojo-TTS-Light 80M167.00M4.346.69%Linux CPU
Audio8 TTS Preview 0.1B170.00M4.4011.33%Linux CPU
NeuTTS Nano229.00M4.1227.27%Linux CPU
F5-TTS v1330.00M4.0221.41%Linux CPU
Magpie-TTS357.00M4.387.95%Linux CPU
CosyVoice 3 0.5B500.00M3.975.93%Linux CUDA
Fish Speech 1.5500.00M3.8716.46%Linux CPU
MiraTTS500.00M3.809.98%Linux CUDA
VibeVoice Realtime 0.5B500.00M4.2210.10%Linux CPU
Qwen3-TTS 0.6B CustomVoice600.00M4.378.71%Linux CPU
Audio8 TTS 0.6B (compiled)601.00M4.435.81%Linux CUDA
Audio8 TTS Preview 0.6B601.00M4.438.71%Linux CPU
Audio8 TTS Realistic 0.6B601.00M4.512.90%Linux CPU
ChatterBox Turbo744.00M4.267.45%Linux CPU
NeuTTS Air748.00M3.7913.89%Linux CPU
Coqui XTTS-v2750.00M4.1911.27%Linux CPU
ZONOS3-Mini (ggml Q4)800.00M3.938.08%Linux CPU
Parler-TTS Mini v1878.00M3.5515.33%Linux CPU
IndexTTS-2.5970.00M3.7715.32%Linux CPU
OmniVoice1.00B4.274.29%Linux CPU
OuteTTS 1.0 1B1.00B4.438.59%Linux CUDA
Sesame CSM-1B1.00B4.1919.18%Linux CPU
ChatterBox1.20B4.445.05%Linux CPU
Mars5-TTS1.20B3.5334.13%Linux CUDA
MetaVoice-1B1.20B3.8033.73%Linux CUDA
LongCat-AudioDiT 1B1.42B4.059.34%Linux CUDA
Ming-3.0-TTS 0.5B1.48B4.047.32%Linux CUDA
IndexTTS-21.50B3.759.47%Linux CPU
LFM2.5-Audio 1.5B1.50B4.379.47%Linux CPU
VibeVoice 1.5B1.50B3.7116.81%Linux CPU
AuK1.53B4.166.31%Linux CUDA
AuK-Flash1.53B4.275.68%Linux CUDA
Dia 1.6B-06261.60B3.0310.15%Linux CUDA
Zonos v0.11.60B4.107.45%Linux CPU
KittenTTS 21.70B4.5114.14%Linux CPU
KittenTTS 2 (C++ CPU)1.70B4.515.81%Linux CPU
Qwen3-TTS 1.7B (CUDA-graph)1.70B4.3013.42%Linux CUDA
Qwen3-TTS 1.7B Base1.70B4.118.08%Linux CPU
dots.tts (soar)2.00B3.657.32%Linux CUDA
LFM3-Audio 2B2.00B4.443.66%Linux CPU
VoxCPM22.00B4.034.29%Linux CPU
FireRedTTS32.12B4.1310.23%Linux CUDA
Echo-TTS2.80B4.217.45%Linux CUDA
Maya13.00B4.475.05%Linux CUDA
Orpheus TTS3.00B4.0010.23%Linux CUDA
Step-Audio-EditX3.00B4.2310.14%Linux CUDA
DramaBox3.30B4.239.34%Linux CUDA
LongCat-AudioDiT 3.5B3.83B4.347.95%Linux CUDA
Fish Speech S2-Pro4.00B4.318.84%Linux CUDA
Higgs Audio v3 TTS4.00B4.488.08%Linux CUDA
VibeVoice 7B7.00B3.508.37%Linux CUDA
MOSS-TTS v1.08.00B4.227.18%Linux CUDA
MOSS-TTS v1.58.00B4.228.08%Linux CUDA
Miso TTS 8B8.20B4.0739.66%Linux CUDA
Ming-3.0-TTS tiny8.98B4.365.18%Linux CUDA
Fish Audio Drama 3 (ComfyUI port)35.90B4.465.05%Linux CUDA

SmollerTTS scores 3.55 UTMOS and 6.69% mean prompt WER here. The WER uses Whisper large-v3. Different voices, runtimes and some evaluator revisions make this a rough overview, and four sentences cannot establish a reliable ranking.

A closer comparison with tiny-voca

I also rendered a separate set of 48 prompts with SmollerTTS and two tiny-voca voices. The set covers everyday speech, narration, dialogue, numbers, technical terms and longer passages. All three voices completed every prompt.

Model / voiceParametersUTMOS WER
SmollerTTS / LJ2.81M3.770.92%
tiny-voca F24.54M4.430.26%
tiny-voca M24.54M4.330.39%

This test uses Whisper small.en and corpus-level WER, so it should be read separately from the graph. I normalized time and unit formatting for all models after inspecting the transcripts; SmollerTTS scored 1.71% WER before that change. The full results include the details.

SmollerTTS is smaller, but tiny-voca scores better on both metrics. That matches what I hear. The words are often clear, but the delivery can still sound flat. A low word error rate does not mean a voice is pleasant to listen to.

What I would improve next

Timing and prosody come first. Longer training runs and bigger decoders did not consistently help in the early experiments. I want to test changes against fixed prompts, with people listening as well as automated scores. After that, I would like to try quantization to reduce the download.

Try it, or help to hillclimb it

The demo, source and weights are public. The repository includes data preparation, training, checkpoint resume, listening tools and ONNX export.

The training guide documents how to train from random initialization. It reproduces the released architecture and recipe, but the complete accepted-recording list from the original run has not been recovered, so it does not promise identical training data selection or checkpoint bytes.

If you’re interested in helping out, send me an email, open a pull request, or file an issue in the repository.

References

  1. Keith Ito and Linda Johnson. The LJ Speech Dataset. 2017.

  2. Jungil Kong, Jaehyeon Kim and Jaekyoung Bae. HiFi-GAN: Generative Adversarial Networks for Efficient and High Fidelity Speech Synthesis. NeurIPS, 2020. Code and pretrained weights.

  3. Takaaki Saeki, Detai Xin, Wataru Nakata, Tomoki Koriyama, Shinnosuke Takamichi and Hiroshi Saruwatari. UTMOS: UTokyo-SaruLab System for VoiceMOS Challenge 2022. Interspeech, 2022. Implementation.

  4. 5uck1ess and contributors. tts-bench. Benchmark snapshot 1dd3a81, accessed 19 November 2026.

Cite this post

@misc{chan2026smollertts,
  title = {{SmollerTTS}, a 2.81M-parameter English text-to-speech model},
  author = {Chan, Dun Li},
  year = {2026},
  month = {nov},
  howpublished = {\url{https://dunlichan.com/writings/smollertts/}},
  note = {Blog post}
}