Local Voice-AI Model Database: Self-Hosted STT & TTS, License-Graded (2026)
Local large language models get all the attention, but a genuinely private AI stack also needs to hear and speak — and the speech models follow different rules. The one that decides what you can actually ship isn’t quality, it’s the license, and text-to-speech in particular is a licensing minefield where the best-sounding models are the ones you legally can’t use in a product. This database scores 21 self-hostable speech-to-text and text-to-speech models on license commercial-safety first, then size, languages, speed by hardware, streaming, and whether they run on a Raspberry Pi — so you can find the model you can both afford to run and legally deploy.
Quick answer
If you're building a private, offline voice tool, the model you can actually SHIP is decided by its license before you ever judge its quality. On speech-to-text you're spoiled: the whole Whisper family (whisper.cpp and faster-whisper, both MIT) is commercial-safe, runs offline, and whisper.cpp reaches down to Raspberry Pi — which is why a local voice-to-text product like DCENT_Voice ships exactly that. NVIDIA's Parakeet (CC-BY-4.0) beats Whisper on English accuracy-per-watt, and Kyutai's streaming STT is natively English-plus-French — the exact Canadian language pair. On text-to-speech it's a minefield: the best-sounding cloners, XTTS-v2 (Coqui's non-commercial CPML, with nobody left to buy a license from) and Fish Speech (CC-BY-NC-SA), are commercial dead ends — while Kokoro-82M and Chatterbox (both permissive) give you commercial-safe quality, and Piper runs on a Pi.
Sort by license first, quality second. Commercial-safe local voice today: whisper.cpp / faster-whisper / Whisper (MIT) and Parakeet (CC-BY) for STT; Kokoro-82M, Chatterbox (MIT), MeloTTS and Piper (GPL — fine self-hosted) for TTS. Treat XTTS-v2 and Fish Speech as personal-use-only, and always check the exact checkpoint — Canary and Voxtral have per-variant license splits.
License: permissive MIT/Apache/BSD — commercial OK attribution CC-BY — commercial OK, credit required copyleft GPL — OK self-hosted non-commercial product dead end · ▪ Pi runs on Raspberry-Pi-class hardware
| Model | Type | License | Languages | Speed / streaming | Min hardware | Best for |
|---|---|---|---|---|---|---|
| Speech-to-Text (STT) | ||||||
| whisper.cpp ▪ PiGeorgi Gerganov (ggml-org) | STT | permissiveMIT | multilingual (~99, incl. FR) | Faster than realtime on ordinary laptop CPUs (base/small); tiny/base run on Raspberry Pi stream: partial | CPU-only, down to Pi / phones | Shipping Whisper inside a product: one C/C++ binary, no Python |
| Same accuracy as the Whisper checkpoint it runs (minor loss at q4/q5) The obvious DCENT_Voice engine. `stream` example is sliding-window pseudo-streaming, not true streaming. | ||||||
| faster-whisperSYSTRAN (CTranslate2) | STT | permissiveMIT | multilingual (incl. FR) | ~4× faster than openai/whisper, less memory; faster-than-realtime large-v3 on mid-range NVIDIA stream: no | CPU workable (small/int8); 4–8 GB VRAM for large-v3 | Fastest full-accuracy Whisper on a GPU or beefy CPU |
| Same WER as reference Whisper for the same checkpoint The default server-side runtime; powers most self-hosted transcription stacks. | ||||||
| Whisper (tiny→large-v3) ▪ PiOpenAI | STT | permissiveMIT | multilingual (~99, incl. FR) | Original PyTorch slow; large-v3-turbo ~8× faster than large-v3 stream: no | CPU for tiny/base; ~10 GB VRAM for large-v3 fp16 | Multilingual accuracy baseline; the weights everything else runs or distils |
| large-v3 ~7.4% avg WER; the multilingual accuracy reference Weights + code MIT — fully commercial-safe. large-v3-turbo (809 M) is the practical default size. | ||||||
| Distil-Whisper (large-v3)Hugging Face | STT | permissiveMIT | English-only | ~6× faster than large-v3; drop-in with faster-whisper/whisper.cpp stream: no | CPU workable quantized; ~4 GB VRAM | English-only pipelines wanting large-v3 accuracy at small-model speed |
| Within ~1% WER of large-v3 on out-of-distribution English English only — a real limit for a bilingual EN/FR audience. | ||||||
| Voxtral Mini 3BMistral AI | STT | permissiveApache-2.0 | multilingual (strong EN/FR/ES/DE) | GPU-class inference; not an edge model stream: no | ~10 GB VRAM (bf16); quantized lower | Speech UNDERSTANDING (transcribe + summarize + answer) fully locally |
| Mistral claims it beats Whisper large-v3 on transcription; also does audio Q&A/summarization July 2025. Do NOT conflate with the separate 2026 'Voxtral TTS' models reported CC-BY-NC (unverified). | ||||||
| Moonshine (tiny/base) ▪ PiUseful Sensors / Moonshine AI | STT | permissiveMIT | English-only | ~5× faster than Whisper equivalents on short clips; runs on Pi-class edge stream: yes | CPU-only, Raspberry Pi / edge | Sub-second-latency voice commands and live captions on tiny hardware |
| Beats Whisper tiny/base WER at comparable size; compute scales with clip length Moonshine v2 (2026) adds a streaming encoder. English-only is the tradeoff. | ||||||
| Vosk ▪ PiAlpha Cephei (Kaldi) | STT | permissiveApache-2.0 | multilingual (20+, incl. FR) | Real-time streaming on CPU incl. Pi and Android stream: yes | CPU-only, Pi / phones | True streaming with partial results on the weakest hardware; mature bindings |
| Worse WER than Whisper-class, but respectable for its size Pre-transformer; pick it for latency and footprint, not accuracy. | ||||||
| WhisperXMax Bain (m-bain) | STT | permissiveBSD-2-Clause | multilingual (alignment per-language) | ~70× realtime batched large-v2 on GPU stream: no | ~8 GB VRAM for full diarization | Word-level timestamps and speaker diarization (meetings, subtitles) |
| Whisper accuracy + accurate word-level timestamps via forced alignment Diarization uses pyannote models needing HF gated-terms acceptance (still free/offline after download). | ||||||
| NVIDIA Parakeet TDT 0.6B (v2/v3)NVIDIA (NeMo) | STT | attributionCC-BY-4.0 | v2 English; v3 25 European (incl. FR) + auto-detect | RTFx ~3380 batched on datacenter GPU; community CPU/GGUF ports faster-than-realtime (unverified) stream: partial | ~2–4 GB VRAM; CPU via community ports | Best English accuracy-per-watt for batch transcription |
| v2 topped Open ASR Leaderboard at 6.05% avg WER — beats Whisper large-v3 on English CC-BY-4.0 = commercial OK with attribution. Native runtime is NeMo (heavier than whisper.cpp). | ||||||
| NVIDIA Canary (1b-flash / 1b-v2)NVIDIA (NeMo) | STT | attributionCC-BY-4.0 (flash/v2); original canary-1b CC-BY-NC | flash EN/DE/FR/ES + translation; v2 25 European | >1000 RTFx batched on GPU stream: no | ~4 GB VRAM | Combined transcription + speech translation (EN↔FR) in one local model |
| SOTA multitask ASR + speech-translation at release 🔴 License VARIES BY VARIANT: original canary-1b = CC-BY-NC (non-commercial); flash + v2 = CC-BY-4.0. Check the exact checkpoint. | ||||||
| Kyutai STT (1b-en_fr / 2.6b-en)Kyutai Labs | STT | attributionCC-BY-4.0 (weights); code Apache/MIT | English + French (1B); English (2.6B) | Natively real-time streaming, 0.5 s delay; an H100 serves 400 streams stream: yes | GPU recommended; 1B on consumer GPUs / Apple Silicon (MLX) | True low-latency streaming dictation — and EN+FR is exactly the D-Central language pair |
| Competitive WER with word-level timestamps; built for streaming Delayed Streams Modeling (from Moshi). CC-BY-4.0 = commercial OK with attribution. | ||||||
| Text-to-Speech (TTS) | ||||||
| Kokoro-82Mhexgrad | TTS | permissiveApache-2.0 | primarily English (strong); 8 langs thinner (FR limited) | Faster than realtime on modern desktop CPUs; trivially realtime on any GPU stream: partial | CPU-only (desktop); ~1–3 GB RAM | Best permissive-licensed quality-per-FLOP — the default for commercial local narration |
| Punches far above its weight — topped community TTS rankings vs far larger models Apache-2.0 weights trained only on permissive audio. Fixed voice pack, no cloning. Pi 5 borderline (unverified). | ||||||
| Chatterbox / MultilingualResemble AI | TTS | permissiveMIT | English (base); Multilingual 23+ incl. FR | Realtime on mid-range NVIDIA (A10/3060); CPU slow (unverified) stream: partial | ~6 GB VRAM; CPU/ROCm via community | The best MIT-licensed zero-shot voice cloning — the commercial-safe XTTS replacement |
| Beat ElevenLabs in blind preference (~63%, vendor eval); emotion-exaggeration control Output carries Resemble's PerTh neural watermark baked in — transparency plus or caveat depending on use. | ||||||
| MeloTTSMyShell.ai / MIT | TTS | permissiveMIT | EN (multi-accent), FR, ES, ZH, JP, KR | CPU real-time inference is an explicit design goal stream: partial | CPU-only (desktop) | Permissive multilingual (incl. French) CPU realtime TTS |
| Solid mid-tier — better than Piper, below Kokoro/XTTS One of the few MIT models with a proper French voice. Quiet since 2024 but widely deployed. | ||||||
| StyleTTS 2Yinghao Aaron Li et al. | TTS | permissiveMIT | English-only (official) | Faster than realtime on GPU; heavy on CPU (unverified) stream: no | ~4 GB VRAM | Research-grade naturalness; fine-tuning your own high-quality English voice |
| Paper reports surpassing human-recording MOS on LJSpeech; the architecture behind Kokoro MIT, but repo asks users not to clone voices without consent. Kokoro is its production-ready descendant. | ||||||
| BarkSuno | TTS | permissiveMIT | 13+ (incl. FR) | Below realtime on CPU; needs GPU (~12 GB full, ~8 GB small) stream: no | 8 GB VRAM (small) / 12 GB (full) | Expressive one-off audio with nonverbal sounds |
| Expressive text-to-AUDIO (laughter, sfx) but unstable/hallucination-prone; not precision TTS Relicensed MIT in 2023. No reliable voice control; unmaintained since ~2023. | ||||||
| Orpheus TTS (3B/1B/…)Canopy Labs | TTS | permissiveApache-2.0 | English primary; multilingual research checkpoints | ~200 ms streaming latency on GPU; runs in GGUF via llama.cpp-style runtimes stream: yes | ~6–8 GB VRAM for 3B quantized | Streaming conversational TTS inside an LLM-style local stack (same tooling as your LLMs) |
| Human-like emotive speech from a Llama-3.2 backbone; strong zero-shot cloning Llama-architecture → slots into existing GGUF/llama.cpp pipelines. Attractive if you already run local LLMs. | ||||||
| Parler-TTS (mini/large)Hugging Face | TTS | permissiveApache-2.0 | English-only | ~realtime on mid-range GPUs; slow on CPU (unverified) stream: partial | ~6 GB VRAM | Prompt-described voice characteristics without a reference clip |
| Good naturalness with text-description voice control ('a calm female speaker…') Effectively dormant since 2024; superseded by Kokoro/Chatterbox for most uses. | ||||||
| Piper ▪ PiRhasspy → Open Home Foundation | TTS | copyleftMIT (archived) / GPL-3.0 (maintained piper1-gpl) | multilingual (30+, incl. FR) | Faster than realtime on Raspberry Pi 4; near-instant on desktop CPU stream: partial | CPU-only, Raspberry Pi | Instant offline speech on the weakest hardware; voice-assistant responses |
| Clearly synthetic but pleasant and highly intelligible; the embedded/assistant standard 🔴 License split: original MIT repo archived Oct 2025; active dev (piper1-gpl) is GPL-3.0 (embeds espeak-ng). Fine self-hosted; matters if embedding in distributed proprietary software. Per-voice dataset licenses vary. | ||||||
| XTTS-v2Coqui (defunct) / community fork | TTS | non-commercialCPML-1.0 (Coqui Public Model License) | 17 (incl. FR) | <200 ms streaming on GPU; CPU well below realtime stream: yes | ~4–6 GB VRAM | Hobby/personal multilingual cloning where non-commercial is acceptable |
| Still one of the best open zero-shot voice cloners (6 s reference); natural prosody 🔴 CPML = NON-COMMERCIAL (covers the audio output too), and with Coqui shut down there is NO ONE to buy a commercial license from — a dead end for any commercial product. Library code (MPL-2.0) is fine; the WEIGHTS are locked. | ||||||
| Fish Speech / OpenAudio S1-miniFish Audio | TTS | non-commercialCC-BY-NC-SA-4.0 (weights); code Apache | multilingual (13+, incl. FR) | ~realtime on RTX 4060-class (community, unverified) stream: partial | ~4–6 GB VRAM | High-quality zero-shot cloning for personal/research use only |
| Near-SOTA open cloning with emotion markers; S1 leads community arenas 🔴 Non-commercial share-alike weights — same commercial dead-end as XTTS-v2 (Fish sells API access separately). | ||||||
Open data (CC BY 4.0): CSV · JSON · API: /wp-json/dc/v1/voice-ai-models?type=STT
Speech-to-text is easy; text-to-speech is a minefield
On the transcription side, you’re spoiled for commercial-safe choice. The entire Whisper family is MIT-licensed, and almost nobody runs OpenAI’s original Python — the real workhorses are whisper.cpp (a single C/C++ binary that runs down to a Raspberry Pi) and faster-whisper (four times faster on a GPU), both MIT. NVIDIA’s Parakeet edges out Whisper on English accuracy-per-watt under a permissive CC-BY licence, and Kyutai’s streaming model happens to be natively English-and-French — the exact bilingual pair a Canadian tool needs. Text-to-speech is where it gets treacherous: the two best open voice cloners, XTTS-v2 and Fish Speech, carry non-commercial licences, and in XTTS-v2’s case the company that could have sold you a commercial licence no longer exists. If you need commercial-safe synthesis, the answers are Kokoro-82M and Chatterbox (permissive, and both punch above their weight), with Piper for anything that has to run on tiny hardware.
What powers DCENT_Voice
A local, private voice-to-text tool like our own DCENT_Voice realistically ships the whisper.cpp / faster-whisper family: permissively licensed end to end (the Whisper weights are MIT too), no Python runtime to bundle, quantized GGML models that fit on modest hardware, and a clean CPU-only path all the way down to Pi-class devices, with a GPU fast-path for anyone who has VRAM. That’s not a marketing choice — it’s what the licence and hardware columns in the table above force if you want something you can actually distribute. For the models that generate text rather than transcribe it, see the companion local LLM model database; to size the hardware, the VRAM calculator; and to check whether any of it phones home, the telemetry & air-gap audit. Everything ties back to the Local LLM Canada hub.
Related products, repair, and setup paths
- immersion cooling hub
- home immersion cooling guide
- ASIC miners for immersion planning
- ASIC cooling parts
- airflow shroud before immersion
- compare miner specs in the database
- ASIC repair support
Last reviewed July 18, 2026.
