Senior System Software Engineer, Speech AI

NVIDIA Corporation; Pune District; On-site; INR 4,000,000 - 7,000,000; Full time

Job summary

NVIDIA Corporation seeks a Senior System Software Engineer with depth in speech technologies to support enterprise and developer customers. You will build and optimize ASR, TTS, ALM, and S2S systems, leveraging CUDA for GPU acceleration and delivering production‑grade speech services.

Ideal candidates have 6+ years in C++/Python, strong debugging skills, and experience with real‑time streaming audio and cloud deployment. This role is positioned to impact AI at scale.

Qualifications

• Masters or BE/BTech in CS or related field.
• 6+ years of software development experience.
• Strong C++ and Python programming with debugging and performance analysis.
• Experience with inference pipelines for LLM, speech recognition and speech synthesis.
• Knowledge of transformers, CNNs and RNNs.
• Experience deploying cloud services using HTTP REST, gRPC and WebSockets.
• Ability to work independently and influence within a dynamic matrix environment.
• Knowledge of real‑time streaming audio systems and low‑latency architectures.
• Experience with speech model fine‑tuning or customization.

Responsibilities

• Develop GPU‑accelerated AI systems at scale.
• Tackle real‑time streaming audio processing and low‑latency inference.
• Troubleshoot ASR, TTS, ALM and S2S pipelines.
• Model integration: transition ASR, TTS and S2S models from research to production readiness.
• Develop Core Speech Services in C++ and Python with CUDA.
• Optimize inference latency and throughput with batching and caching.
• Contribute to Python and C++ client SDKs and CLI tools.
• Assist with API integration, SDK usage, model deployment and performance optimization.
• Provide advanced technical guidance to customers implementing speech technology solutions.

Skills

C++ & Python

Performance debugging

Inference pipelines

Transformers

Cloud services

Real-time audio

Team collaboration

Independent work

Education

Masters or BE/BTech in CS

Tools

CUDA

REST/gRPC

WebSockets

Job description

Widely considered to be one of the technology world’s most desirable employers, NVIDIA is an industry leader with groundbreaking developments in High-Performance Computing, Artificial Intelligence and Visualization. The GPU, our invention, serves as the visual cortex of modern computers and is at the heart of our products and services. GPU deep learning ignited modern AI — the next era of computing — with the GPU acting as the brain of computers, robots, autonomous cars and conversational AI that can perceive and understand the world. Today, we are increasingly known as “the AI computing company.” We're looking to grow our company, and build our teams with the smartest people in the world. Join us at the forefront of technological advancement.

NVIDIA is looking for a Senior System Software Engineer with deep expertise in speech technologies to support enterprise and developer customers. This role involves hands‑on technical engagement with customers to implement, troubleshoot, and optimize Automatic Speech Recognition (ASR), Text-to-Speech (TTS), Audio Language Models (ALM), and Speech-to-Speech (S2S) systems in production environments. If you're creative & passionate about solving real world conversational AI problems, come join our Speech AI Engineering team.

What you’ll be doing:

• Work on cutting‑edge GPU‑accelerated AI systems deployed at scale
• Tackle challenging problems in real‑time streaming audio processing and low‑latency inference
• Troubleshoot and resolve complex issues across ASR, TTS, ALM, and S2S pipelines
• Model Integration: Work alongside Model researchers to transition ASR, TTS and S2S models from research to production readiness.
• Develop Core Speech Services: Build and enhance C++ & python backend implementations for ASR, TTS, and S2S pipelines, leveraging CUDA for GPU acceleration
• Optimize Inference Performance: Improve streaming latency and throughput through advanced batching strategies, encoder caching, and multi‑threaded pipeline optimizations
• Feature Development: Add new capabilities such as advanced voice activity detection, speaker diarization, decoder implementations (CTC, WFST, Flashlight), and text post‑processing
• Client Libraries: Contribute to Python and C++ client SDKs and CLI tools for easy service integration
• Assist with API integration, SDK usage, model deployment, and performance optimization
• Provide advanced technical guidance to customers implementing speech technology solutions

What we need to see:

• Masters or BE/BTech in Computer Science, computer architecture, or related field
• 6+ years of experience
• Excellent C++ & Python programming and software design skills, including debugging, performance analysis, and test design.
• Experience with inference pipelines for LLM, Speech Recognition & Speech Synthesis
• Solid understanding of modern model architectures (Transformers, CNNs, RNNs)
• Excellent debugging abilities spanning multiple software (storage systems, kernels and containers)
• Experience building and deploying cloud services using HTTP REST, gRPC, Websockets and related technologies
• Strong collaborative and interpersonal skills, specifically a proven ability to effectively guide and influence within a dynamic matrix environment
• Ability to work independently, define project goals and scope and manage your own development effort.
• Knowledge of real‑time streaming audio systems and low‑latency architectures
• Experience with speech model fine‑tuning or customization

Ways to stand out from the crowd:

• Publications or contributions to ML optimization open‑source projects.
• Experience with embedded systems or edge deployment

NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

NVIDIA pioneered accelerated computing. Today, our AI infrastructure powers global intelligence, transforming every industry. Learn more about NVIDIA.