Senior Lead, Cloud AI/ML Training Infrastructure

JP Morgan Chase

Palo Alto (CA)

On-site

USD 180,000 - 240,000

Full time

9 days ago

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

JPMorganChase is seeking a Senior Lead Software Engineer to design, build, and operate secure, scalable infrastructure platforms powering enterprise AI/ML workloads. You will lead cross-functional efforts with AI/ML teams, platform engineers, and product owners to deliver production-grade multi-GPU training platforms.

You will drive technical decisions, ensure security and resiliency, and advance automation, developer productivity, and operational excellence across the SDLC.

Qualifications

5+ years in software engineering with scalable infra experience.
Hands-on building scalable infrastructure for ML training and inference.
Strong GPU infra knowledge and interconnects.

Responsibilities

Design, develop, test, and deliver secure production code.
Architect and operate scalable cloud infrastructure for multi-GPU AI/ML training.
Collaborate with AI/ML teams to translate requirements into platform capabilities.
Guide design decisions affecting architecture, security, and operations.
Monitor and optimize cloud/GPU resources for performance and cost efficiency.
Build CI/CD pipelines and infrastructure-as-code for ML platforms.

Skills

Kubernetes & containers

Cloud infrastructure

Programming languages

AI/ML platform knowledge

Secure coding practices

Leadership & mentoring

SDLC tooling & AI-assisted development

Tools

NVIDIA DCGM/BCM

MLflow or similar

Ray.io / Slurm

Job description

You will drive technical decisions, ensure security and resiliency, and advance automation, developer productivity, and operational excellence across the SDLC.

Get your free, confidential resume review.

or drag and drop your file here.