NVIDIA NeMo Speech Developer Docs
NeMo-Speech
NVIDIA NeMo Speech
is an open-source toolkit for speech, audio, and multimodal language model research, with a clear path from experimentation to production deployment.
🎙️ Transcribe Speech (ASR) Convert audio to text with state-of-the-art accuracy. Supports 14+ languages, streaming, and timestamps. Quick Start →
🔊 Synthesize Speech (TTS) Generate natural human speech from text. Multi-language, multi-speaker, with controllable prosody. Quick Start →
👥 Identify Speakers Determine "who spoke when" in multi-speaker audio. Speaker diarization, recognition, and verification. Quick Start →
🧠 Speech Language Models Audio-aware LLMs that understand and generate speech. Use HuggingFace Transformers, or NeMo Automodel for efficient MoE and model parallelism. Speech-to-text, speech-to-speech, and more. Quick Start →
🎧 Process Audio Enhance, restore, and separate audio signals. Improve audio quality for downstream tasks. Quick Start →
🛠️ Speech AI Tools Forced alignment, data exploration, CTC segmentation, and evaluation utilities for speech workflows. Explore Tools →
What is NeMo Speech?
#
NVIDIA NeMo Speech
is an open-source toolkit for building, customizing, and deploying speech, audio, and multimodal language models. It provides:
Pretrained models — production-ready checkpoints on
NGC
and
HuggingFace Hub
Modular architecture — neural modules you can mix, match, and extend
Scalable training — multi-GPU/multi-node via PyTorch Lightning with mixed-precision support
Simple configuration — YAML-based experiment configs with
Hydra
Get started (install the PyTorch build for your platform first):
uvpipinstall'nemo-toolkit[asr,tts]'importnemo.collections.asrasnemo_asrmodel=nemo_asr.models.ASRModel.from_pretrained("nvidia/parakeet-tdt-0.6b-v2")print(model.transcribe(["audio.wav"])[0].text)Trying to finetune a model?
#
Check out our latest /nemo-speech-finetune-asr
agent skill
.
Collections
Automatic Speech Recognition (ASR)
Text-to-Speech (TTS)
Resources and Documentation
SpeechLM2
Speaker Diarization
Speaker Recognition (SR)
Speech and Audio Processing
Resources and Documentation
Speech Self-Supervised Learning
Speech Classification
Speech AI Tools
NeMo Forced Aligner (NFA)
Dataset Creation Tool Based on CTC-Segmentation
Speech Data Explorer
Comparison tool for ASR Models
ASR Evaluator
Speech Data Processor
APIs
NeMo Models
Neural Modules
Experiment Manager
Neural Types
Adapters
NeMo Core APIs
NeMo Common Collection API
NeMo ASR API
NeMo TTS API
NeMo Audio API