Senior AI Tools & Systems PM — ML Infra & Serving

Deepgram, Inc.; United States; On-site; USD 150,000 - 230,000; Full time

Job summary

Deepgram, Inc. is seeking a Senior Technical Program Manager (AI Tooling & Systems) to drive end-to-end ML infrastructure initiatives, spanning model training pipelines, evaluation, and real-time inference at scale.

You will partner with ML researchers, engineers, and product to align on strategy, deliver scalable tooling, and optimize latency and cost while accelerating ML iteration cycles.

Qualifications

• 5+ years of program management or technical leadership in ML infrastructure, ML platforms, or AI tooling.
• Strong technical acumen in ML systems—hands-on experience as an ML engineer, systems engineer, or ML infrastructure engineer.
• Experience coordinating cross-functional ML programs (model training → evaluation → serving → monitoring).
• Proven ability to translate ML/research requirements into robust, scalable infrastructure.
• Comfortable working in ambiguity and helping teams navigate complex technical tradeoffs (accuracy vs. latency vs. cost).
• Excellent communication with both technical and non-technical stakeholders.
• Familiarity with high-growth or startup environments.

Responsibilities

• Own end-to-end delivery of AI infrastructure programs—from model training pipelines and experiment tracking to inference serving and production monitoring.
• Define technical architecture, integration patterns, and rollout strategies for new ML systems and tooling.
• Serve as connective tissue between ML research, ML engineering, product, and data teams to align on ML system requirements, capability roadmaps, and deployment timelines.
• Drive cost and latency optimization for real-time inference workloads at scale.
• Build lightweight internal tools and processes to accelerate ML iteration cycles (experiment tracking, model versioning, A/B testing infrastructure).
• Identify and resolve technical bottlenecks in training pipelines, serving infrastructure, and model evaluation workflows.
• Work closely with ML practitioners to translate research breakthroughs into scalable, observable systems.

Skills

ML infrastructure

Cross-functional leadership

ML systems

Technical communication

Startup experience

Tools

Model serving frameworks

ML experiment tracking

TensorRT

Job description

Deepgram, Inc. is seeking a Senior Technical Program Manager (AI Tooling & Systems) to drive end-to-end ML infrastructure initiatives, spanning model training pipelines, evaluation, and real-time inference at scale.

You will partner with ML researchers, engineers, and product to align on strategy, deliver scalable tooling, and optimize latency and cost while accelerating ML iteration cycles.