Senior ML Platform Engineer: GPU Training & Cloud

JPMorganChase; Palo Alto (CA); On-site; USD 160,000 - 210,000; Full time

Job summary

JPMorganChase in Palo Alto is seeking a Software Engineer III to join the AI/ML data platform team. You will build and operate scalable ML training systems on AWS and other clouds, productionizing GPU workloads and improving performance and cost efficiency.

You’ll work in an agile team to design end-to-end training pipelines, run distributed GPU training, and operate training infra on Kubernetes, with strong emphasis on governance, observability, and secure, reusable patterns.

Qualifications

• Formal training or certification in software engineering and 3+ years of applied experience.
• Experience running ML training in cloud environments and debugging across infra and code.
• Strong Python skills with solid engineering practices (testing, reviews, modular design).
• Experience building automation/CI for ML codebases (build, test, release, deployment).
• Hands-on experience with deep learning training workflows and major frameworks.
• Understanding of training performance, data loading, mixed precision, checkpointing, reproducibility.

Responsibilities

• Design, build, and maintain end-to-end ML training platform.
• Run and optimize GPU training workloads (single-node and distributed).
• Build and operate training infrastructure on Kubernetes (EKS) and cloud.
• Enable Gen AI/LLM training workflows with governance and scalable GPU execution.
• Implement observability: metrics, logs, dashboards, alerts, runbooks.
• Collaborate with data engineering and platform teams to define interfaces and guardrails.
• Improve developer experience with containers, CI/CD, templates, and self-service workflows.
• Use AI-assisted development tools with code reviews, testing, and secure coding standards.

Skills

Python

Kubernetes

AWS

ML pipelines

GPU training

CI/CD

Distributed training

Debugging

Performance optimization

Security practices

Tools

EKS

S3

IAM

CloudWatch

Docker

CI/CD tooling

Job description

JPMorganChase in Palo Alto is seeking a Software Engineer III to join the AI/ML data platform team. You will build and operate scalable ML training systems on AWS and other clouds, productionizing GPU workloads and improving performance and cost efficiency.

You’ll work in an agile team to design end-to-end training pipelines, run distributed GPU training, and operate training infra on Kubernetes, with strong emphasis on governance, observability, and secure, reusable patterns.