Senior Director, AI Infra Platform (Kubernetes + GPU)

Aumni

United States

On-site

USD 250,000 - 350,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

JPMorganChase is seeking a Senior Director of Software Engineering to lead the AI Infrastructure Platform across on‑premises and cloud environments. You will guide architecture, deliver a Kubernetes-first platform for training and inference, and ensure security, reliability, and scalability at enterprise scale.

You will manage multiple departments and engineers, drive platform APIs, governance, and observability while partnering with AI/ML, infra, risk, and vendor teams.

Qualifications

  • 15+ years of engineering experience, including 8+ years of senior engineering leadership with responsibility for managing managers.
  • Demonstrated experience delivering platform products with strong adoption, reliability, and operational maturity.
  • Experience developing and leading large, cross-functional engineering teams within highly matrixed and complex enterprise environments.
  • Proven track record of leading complex initiatives supporting distributed system design, testing, and operational stability at scale.
  • Deep hands-on expertise with Kubernetes-based platforms, including multi-tenant, RBAC, admission control, and network policy.

Responsibilities

  • Lead multiple technology and platform implementations across departments to deliver firmwide AI infrastructure objectives, with a primary focus on training and experimentation platforms at enterprise scale.
  • Own the design, delivery, and evolution of a Kubernetes-first AI Infrastructure platform, including Kubernetes-native support for batch and distributed training & inference jobs, lifecycle management, retry semantics, and failure recovery patterns.
  • Standardize AI developer workflows for experimentation, enabling self-service job submission, reusable templates and golden paths, reproducibility mechanisms, and consistent runtime behavior across hybrid deployment environments.
  • Build and evolve platform APIs and automation, including Kubernetes controllers and operators where appropriate, to ensure the platform is safe, scalable, and easy to adopt across teams.
  • Drive measurable improvements in GPU availability and utilization through reliability engineering, fleet readiness patterns, and accelerated capacity onboarding.
  • Define and implement governance-based scheduling and placement strategies, including multitenant GPU quotas and guardrails, priority, admission control, and reservation patterns.

Skills

Kubernetes platforms
Platform products
Leadership of managers
AI training platforms
GPU infrastructure
Cloud-native tech
Security governance
Observability

Tools

Kubernetes

Job description

JPMorganChase is seeking a Senior Director of Software Engineering to lead the AI Infrastructure Platform across on‑premises and cloud environments. You will guide architecture, deliver a Kubernetes-first platform for training and inference, and ensure security, reliability, and scalability at enterprise scale.

You will manage multiple departments and engineers, drive platform APIs, governance, and observability while partnering with AI/ML, infra, risk, and vendor teams.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Director, AI Infra Platform & Kubernetes
Senior Director, AI Infra Platform & Kubernetes

JPMorgan Chase & Co. • Seattle (WA)

Hybrid
USD 240,000 - 360,000
Diversity & Inclusion focus
Director, AI Infrastructure & Cloud Platform
Director, AI Infrastructure & Cloud Platform

JP Morgan Chase • New York (NY)

On-site
USD 190,000 - 300,000
Senior Director, AI-Driven Infra & Cloud Platform
Senior Director, AI-Driven Infra & Cloud Platform

JP Morgan Chase • Jersey City (NJ)

On-site
USD 180,000 - 320,000
Senior Lead, Cloud AI/ML Training Infrastructure
Senior Lead, Cloud AI/ML Training Infrastructure

JP Morgan Chase • Palo Alto (CA)

On-site
USD 180,000 - 240,000
Senior ML Platform Engineer: GPU Training & Cloud Infra
Senior ML Platform Engineer: GPU Training & Cloud Infra

JPMorgan Chase & Co. • Palo Alto (CA)

On-site
USD 180,000 - 240,000
Senior AI/ML Platform Engineer — Cloud Infra & Pipelines
Senior AI/ML Platform Engineer — Cloud Infra & Pipelines

JP Morgan Chase • Jersey City (NJ)

On-site
USD 140,000 - 210,000
Sr Director of Software Engineering- AI Infrastructure Platforms
Sr Director of Software Engineering- AI Infrastructure Platforms

JPMorgan Chase & Co. • Seattle (WA)

Hybrid
USD 240,000 - 360,000
Diversity & Inclusion focus
Senior Lead Engineer, AI Inference Platform
Senior Lead Engineer, AI Inference Platform

Aumni • Seattle (WA)

On-site
USD 180,000 - 260,000
Sr. Lead Software Engineer, AI Platform & Scale
Sr. Lead Software Engineer, AI Platform & Scale

JPMorgan Chase & Co. • Jersey City (NJ)

On-site
USD 150,000 - 200,000
Lead Software Engineer — AI-Driven Infra & Cloud
Lead Software Engineer — AI-Driven Infra & Cloud

Aumni • Plano (TX)

On-site
USD 140,000 - 190,000
Health care coverage
On-site wellness centers
Retirement savings plan
+4