Senior ML Platform Engineer - GPU Training Systems

JPMorgan Chase & Co.; Palo Alto (CA); On-site; USD 150,000 - 210,000; Full time

Job summary

JPMorganChase is seeking a Software Engineer III to join the AI/ML data platform team. You will design, build, and operate scalable ML training systems on AWS and other clouds, focusing on GPU workloads and repeatable, well-governed training across environments.

You will work with data engineering and platform teams to implement observability, CI/CD, and secure, high-performance training pipelines, ensuring robust, producible workflows and reusable patterns for enterprise use.

Qualifications

• Formal training or certification on software engineering concepts and 3+ years applied experience.
• Demonstrated experience running ML training in cloud environments and debugging issues across infrastructure & code.
• Strong Python skills with solid engineering practices (testing, code reviews, modular design, dependency management).
• Experience building automation/CI for ML codebases (build, test, release, deployment/promotion workflows).
• Hands on experience with deep learning training workflows and at least one major framework (e.g., PyTorch or TensorFlow).
• Understanding of training performance and stability: data loading bottlenecks, mixed precision, checkpointing, reproducibility, and evaluation methodology.
• Experience with distributed training and related concepts (e.g., DDP/FSDP/DeepSpeed concepts, collective communication basics, scaling and bottleneck analysis).
• Ability to profile and optimize training systems (CPU/GPU utilization, memory, I/O throughput, networking, scheduling).
• Experience with Kubernetes fundamentals for running compute-intensive workloads and AWS (eg., EKS/ECR, S3, IAM, VPC/networking, Cloudwatch, EC2)
• Hands-on experience using enterprise-authorized AI-assisted software development tools within the work environment with demonstrated ability to critically evaluate outputs.

Responsibilities

• Design, build, and maintain end-to-end ML training platform.
• Run and optimize GPU training workloads (single-node and distributed).
• Build and operate training infrastructure on Kubernetes (e.g., EKS and other managed Kubernetes platforms).
• Enable Gen AI/LLM training and fine-tuning workflows with governance and scalable GPU execution patterns.
• Implement observability for training systems: metrics, logs, dashboards, alerting, and runbooks.
• Partner with data engineering and platform teams to define interfaces, standards, and guardrails (security, cost controls).
• Improve developer experience for training: containers, CI/CD, templates, documentation, self-service workflow.
• Utilize AI-assisted development tools while ensuring correctness, security and peer review.

Skills

Python

ML training

Kubernetes

AWS

PyTorch

TensorFlow

CI/CD

Profiling

Distributed training

Education

Software engineering fundamentals

Tools

EKS

S3

Docker

Job description

JPMorganChase is seeking a Software Engineer III to join the AI/ML data platform team. You will design, build, and operate scalable ML training systems on AWS and other clouds, focusing on GPU workloads and repeatable, well-governed training across environments.

You will work with data engineering and platform teams to implement observability, CI/CD, and secure, high-performance training pipelines, ensuring robust, producible workflows and reusable patterns for enterprise use.