Lead ML Platform Engineer: GPU Training on Cloud

JPMorgan Chase; Palo Alto (CA); On-site; USD 157,000 - 215,000; Full time

Job summary

JPMorgan Chase in Palo Alto, CA, seeks a Lead Software Engineer to join the AI/ML Data Platforms team. You will build scalable, GPU-based ML training systems on AWS and other cloud platforms, productionize training workloads, and drive performance and cost efficiency across environments.

You will design end-to-end training platforms, implement observability, and collaborate with data engineering and platform teams to define interfaces, standards, and guardrails for enterprise AI deployment.

Qualifications

• Formal training or certification in software engineering concepts and 5+ years applied experience.
• Experience running ML training in cloud environments and debugging issues across infrastructure and code.
• Strong Python skills with solid engineering practices, including testing and code reviews.
• Experience building automation/CI for ML codebases and model training workflows.
• Hands-on experience with deep learning training workflows and PyTorch or TensorFlow.

Responsibilities

• Design, build, and maintain an end-to-end ML training platform.
• Run and optimize GPU training workloads across single-node and distributed setups.
• Build and operate training infrastructure on Kubernetes (EKS and others).
• Enable Gen AI/LLM training and fine-tuning workflows with governance and scalability.
• Implement observability: metrics, logs, dashboards, alerts, runbooks.
• Collaborate with data engineering and platform teams to define interfaces and guardrails.
• Improve developer experience with standardized containers, CI/CD, templates, and self-service workflows.
• Foster enterprise AI practices, including secure coding, reviews, and reusable patterns.
• Apply SDLC tooling and AI-assisted development to improve automation.

Skills

Python

Kubernetes

AWS

Distributed training

CI/CD

Deep learning

Performance optimization

Profiling

Education

Bachelor's degree in Computer Science or related field

Tools

EKS

S3

CloudWatch

GPU tooling

Job description

JPMorgan Chase in Palo Alto, CA, seeks a Lead Software Engineer to join the AI/ML Data Platforms team. You will build scalable, GPU-based ML training systems on AWS and other cloud platforms, productionize training workloads, and drive performance and cost efficiency across environments.

You will design end-to-end training platforms, implement observability, and collaborate with data engineering and platform teams to define interfaces, standards, and guardrails for enterprise AI deployment.