Senior Director, AI Infra Platform & Kubernetes

JPMorgan Chase & Co.

Seattle (WA)

Hybrid

USD 240,000 - 360,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Diversity & Inclusion focus

Job summary

JPMorgan Chase & Co. is seeking a Senior Director of Software Engineering to lead the firmwide AI Infrastructure Platform.

You will own a Kubernetes-first AI platform spanning on‑premises, cloud, and accelerated compute vendors, guiding architecture and delivering reliable, secure enterprise-grade systems at scale. You will drive training and experimentation capabilities, standardize developer workflows, and spearhead governance, security, and observability across job lifecycles and GPU

Qualifications

  • 15+ years of engineering experience including 8+ years in senior leadership.
  • Proven track record delivering platform products with high adoption and reliability.
  • Experience leading large cross-functional teams in complex enterprises.
  • Expertise with Kubernetes-based platforms including multi-tenancy and RBAC.
  • Experience supporting AI training and experimentation platforms (PyTorch, distributed training).
  • Familiar with Slurm or similar HPC schedulers and batch concepts.
  • Understanding of modern AI inference stacks and GPU memory constraints.
  • Strong cloud-native and hybrid infrastructure experience.
  • Experience hiring and developing top engineering talent.

Responsibilities

  • Lead multiple tech and platform initiatives delivering enterprise-scale AI infrastructure.
  • Design and evolve a Kubernetes-first AI infrastructure platform for training and inference.
  • Standardize developer workflows with self-service job submission and templates.
  • Develop platform APIs, controllers, and operators for safe, scalable adoption.
  • Improve GPU availability and reliability through fleet readiness and onboarding.
  • Implement governance-based scheduling, quotas, and guardrails for GPUs.
  • Embed security, IAM/RBAC, secrets, auditing, and network segmentation.
  • Establish SLIs/SLOs and manage incident response and capacity forecasting.
  • Communicate strategy and align stakeholders at the executive level.
  • Build and mentor a high-performing engineering organization.

Skills

Engineering leadership
Kubernetes platform
AI training platforms
Distributed systems
Cloud-native tech
GPU infrastructure
RBAC & security
Multi-tenancy
Slurm / batch schedulers
Controllers / CRDs

Tools

Kubernetes controllers
CRDs
Ray
NVIDIA GPU tooling

Job description

JPMorgan Chase & Co. is seeking a Senior Director of Software Engineering to lead the firmwide AI Infrastructure Platform.

You will own a Kubernetes-first AI platform spanning on‑premises, cloud, and accelerated compute vendors, guiding architecture and delivering reliable, secure enterprise-grade systems at scale. You will drive training and experimentation capabilities, standardize developer workflows, and spearhead governance, security, and observability across job lifecycles and GPU

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Director, AI Infra Platform (Kubernetes + GPU)
Senior Director, AI Infra Platform (Kubernetes + GPU)

Aumni • United States

On-site
USD 250,000 - 350,000
Senior Director, AI-Driven Infra & Cloud Platform
Senior Director, AI-Driven Infra & Cloud Platform

JP Morgan Chase • Jersey City (NJ)

On-site
USD 180,000 - 320,000
Director, AI Infrastructure & Cloud Platform
Director, AI Infrastructure & Cloud Platform

JP Morgan Chase • New York (NY)

On-site
USD 190,000 - 300,000
Sr. Lead Software Engineer, AI Platform & Scale
Sr. Lead Software Engineer, AI Platform & Scale

JPMorgan Chase & Co. • Jersey City (NJ)

On-site
USD 150,000 - 200,000
Sr Director of Software Engineering- AI Infrastructure Platforms
Sr Director of Software Engineering- AI Infrastructure Platforms

JPMorgan Chase & Co. • Seattle (WA)

Hybrid
USD 240,000 - 360,000
Diversity & Inclusion focus
Senior Principal AI Platform Architect
Senior Principal AI Platform Architect

JPMorgan Chase • Plano (TX)

On-site
USD 180,000 - 240,000
Senior AI/ML Platform Engineer — Cloud Infra & Pipelines
Senior AI/ML Platform Engineer — Cloud Infra & Pipelines

JP Morgan Chase • Jersey City (NJ)

On-site
USD 140,000 - 210,000
Cloud Platform Lead Engineer – AI/ML Data Platforms
Cloud Platform Lead Engineer – AI/ML Data Platforms

Aumni • Jersey City (NJ)

On-site
USD 180,000 - 240,000
AI Infrastructure Director: Strategy, DevOps & Reliability
AI Infrastructure Director: Strategy, DevOps & Reliability

Aumni • Columbus (OH)

On-site
USD 250,000 - 360,000
Cloud Platform Principal Engineer — AI & DevEx Lead
Cloud Platform Principal Engineer — AI & DevEx Lead

JPMorgan Chase & Co. • Palo Alto (CA)

Remote
USD 180,000 - 240,000