Senior ML Platform Engineer - GPU & Cloud

Socket.dev; Palo Alto (CA); On-site; USD 150,000 - 190,000; Full time

Job summary

JPMorganChase is seeking a Software Engineer III to join the AI/ML data platform team in Palo Alto. You will design, build, and operate scalable ML training systems on AWS and other clouds, focusing on GPU workloads, performance, and cost efficiency.

You will enable Gen AI/LLM training, implement observability, and collaborate with data engineering to standardize interfaces and governance. You will own end-to-end training pipelines, optimize throughput, and contribute to automated testing,

Qualifications

• Formal training or certification on software engineering concepts.
• Demonstrated experience running ML training in cloud environments and debugging issues.
• Strong Python skills with solid engineering practices (testing, code reviews, modular design, dependency management).
• Experience building automation/CI for ML codebases (build, test, release, deployment/promotion workflows).
• Hands on experience with deep learning training workflows and at least one major framework (e.g., PyTorch or TensorFlow).
• Understanding of training performance and stability: data loading bottlenecks, mixed precision, checkpointing, reproducibility, and evaluation methodology.

Responsibilities

• Design, build, and maintain end-to-end ML training platform.
• Run and optimize GPU training workloads (single-node and distributed).
• Build and operate training infrastructure on Kubernetes (EKS, etc.).
• Enable Gen AI/LLM training and fine-tuning workflows with governance.
• Implement observability: metrics, logs, dashboards, alerting, runbooks.
• Collaborate with data engineering and platform teams on interfaces and guardrails.
• Improve developer experience with containers, CI/CD, templates, docs, self-service workflows.
• Leverage AI-assisted development tools with code quality and security focus.
• Apply SDLC tooling knowledge to improve automation.

Skills

Python

CI/CD

ML training

Kubernetes

AWS

GPU training

Profiling

Testing

Education

Software engineering certification

Tools

PyTorch

TensorFlow

Jenkins

EKS

S3

Git

Job description

JPMorganChase is seeking a Software Engineer III to join the AI/ML data platform team in Palo Alto. You will design, build, and operate scalable ML training systems on AWS and other clouds, focusing on GPU workloads, performance, and cost efficiency.

You will enable Gen AI/LLM training, implement observability, and collaborate with data engineering to standardize interfaces and governance. You will own end-to-end training pipelines, optimize throughput, and contribute to automated testing,