Senior AI Infrastructure & Tooling Programs Lead

Apply; United States; On-site; USD 150,000 - 190,000; Full time

Job summary

Deepgram is seeking a Senior Technical Program Manager (AI Tooling & Systems) to drive the end-to-end delivery of large-scale ML infrastructure and tooling initiatives, spanning model training pipelines, real-time inference, and tooling development. You will partner with ML researchers, engineers, and product teams to unlock capability at scale.

You thrive on creating clarity around complex ML system tradeoffs, building tools to accelerate model development, and aligning technical strategy with

Qualifications

• 5+ years of program management or technical leadership in ML infrastructure, ML platforms, or AI tooling (or equivalent).
• Strong technical acumen in ML systems—hands-on experience as an ML engineer or systems engineer is a plus.
• Experience coordinating cross-functional ML programs (model training → evaluation → serving → monitoring).
• Ability to translate ML/research requirements into robust, scalable infrastructure.
• Comfort with ambiguity and navigating complex technical tradeoffs (accuracy vs. latency vs. cost).
• Excellent communication with both technical and non-technical stakeholders.

Responsibilities

• Own end-to-end delivery of AI infrastructure programs—from model training pipelines to inference serving and production monitoring.
• Define architecture, integration patterns, and rollout strategies for new ML systems and tooling.
• Serve as connective tissue between ML research, ML engineering, product, and data teams.
• Drive cost and latency optimization for real-time inference at scale.
• Build internal tools and processes to accelerate ML iteration cycles (experiment tracking, model versioning, A/B testing).
• Identify and resolve bottlenecks in training pipelines, serving infrastructure, and evaluation workflows.
• Collaborate with ML practitioners to translate research breakthroughs into scalable, observable systems.

Skills

ML infrastructure

Program management

Cross-functional leadership

Communication

Ambiguity navigation

Tools

vLLM

TensorRT

TorchServe

MLflow

Weights & Biases

Job description

Deepgram is seeking a Senior Technical Program Manager (AI Tooling & Systems) to drive the end-to-end delivery of large-scale ML infrastructure and tooling initiatives, spanning model training pipelines, real-time inference, and tooling development. You will partner with ML researchers, engineers, and product teams to unlock capability at scale.

You thrive on creating clarity around complex ML system tradeoffs, building tools to accelerate model development, and aligning technical strategy with