NVIDIA NeMo Speech Developer Docs

NeMo-Speech

NVIDIA NeMo Speech

is an open-source toolkit for speech, audio, and multimodal language model research, with a clear path from experimentation to production deployment.

🎙️ Transcribe Speech (ASR) Convert audio to text with state-of-the-art accuracy. Supports 14+ languages, streaming, and timestamps. Quick Start →

🔊 Synthesize Speech (TTS) Generate natural human speech from text. Multi-language, multi-speaker, with controllable prosody. Quick Start →

👥 Identify Speakers Determine "who spoke when" in multi-speaker audio. Speaker diarization, recognition, and verification. Quick Start →

🧠 Speech Language Models Audio-aware LLMs that understand and generate speech. Use HuggingFace Transformers, or NeMo Automodel for efficient MoE and model parallelism. Speech-to-text, speech-to-speech, and more. Quick Start →

🎧 Process Audio Enhance, restore, and separate audio signals. Improve audio quality for downstream tasks. Quick Start →

🛠️ Speech AI Tools Forced alignment, data exploration, CTC segmentation, and evaluation utilities for speech workflows. Explore Tools →

What is NeMo Speech?

#

NVIDIA NeMo Speech

is an open-source toolkit for building, customizing, and deploying speech, audio, and multimodal language models. It provides:

Pretrained models — production-ready checkpoints on

NGC

and

HuggingFace Hub

Modular architecture — neural modules you can mix, match, and extend

Scalable training — multi-GPU/multi-node via PyTorch Lightning with mixed-precision support

Simple configuration — YAML-based experiment configs with

Hydra

Get started (install the PyTorch build for your platform first):

uvpipinstall'nemo-toolkit[asr,tts]'importnemo.collections.asrasnemo_asrmodel=nemo_asr.models.ASRModel.from_pretrained("nvidia/parakeet-tdt-0.6b-v2")print(model.transcribe(["audio.wav"])[0].text)Trying to finetune a model?

#

Check out our latest /nemo-speech-finetune-asr

agent skill

.

Collections

Automatic Speech Recognition (ASR)

Text-to-Speech (TTS)

Resources and Documentation

SpeechLM2

Speaker Diarization

Speaker Recognition (SR)

Speech and Audio Processing

Resources and Documentation

Speech Self-Supervised Learning

Speech Classification

Speech AI Tools

NeMo Forced Aligner (NFA)

Dataset Creation Tool Based on CTC-Segmentation

Speech Data Explorer

Comparison tool for ASR Models

ASR Evaluator

Speech Data Processor

APIs

NeMo Models

Neural Modules

Experiment Manager

Neural Types

Adapters

NeMo Core APIs

NeMo Common Collection API

NeMo ASR API

NeMo TTS API

NeMo Audio API