Senior AI/ML Platform Engineer - Cloud & GPU Ops

JP Morgan Chase; Wilmington (DE); On-site; USD 138,000 - 185,000; Full time

Job summary

JPMorgan Chase in Wilmington, DE requires a Senior Lead Software Engineer to design, build, and operate scalable AI/ML platform infrastructure for data scientists and ML engineers. You will lead reliability, scalability, and automation across cloud-native environments in AWS and other clouds, with a focus on GPU workloads and production-grade services.

The role emphasizes platform tooling, IaC, CI/CD, and observability, partnering with cross-functional teams to enable rapid experimentation,

Qualifications

• 5+ years applied experience in software engineering.
• Experience delivering secure, production-quality code in Python or Java.
• Strong foundations in distributed systems, microservices, and platform architecture.

Responsibilities

• Builds and maintains reusable AI/ML platform infrastructure and shared services to support development, deployment, and operations at scale.
• Architects, deploys, and operates secure cloud and container-based environments for training and inference, including GPU-intensive workloads.
• Design and implement platform tooling, automation, and infrastructure-as-code solutions to streamline model deployment, environment provisioning, release management, and operational support.
• Develops and maintains production-grade services, APIs, SDK integrations, and workflows that support model training, serving, evaluation pipelines, and AI application lifecycle management.
• Partners with data science, ML engineering, and application teams to translate model and compute requirements into platform standards and deployment patterns.
• Optimizes platform reliability, scalability, latency, and cost through orchestration, scheduling, and hardware acceleration.
• Establishes operational best practices including monitoring, logging, observability, access controls, incident response, and production troubleshooting.
• Supports enterprise LLM operationalization, including fine-tuning workflows, inference optimization, and evaluation; contribute to documentation and engineering standards.
• Drives adoption and governance of approved AI-assisted engineering practices across teams to improve code quality, delivery speed, and operational outcomes.

Skills

Python

Java

Distributed systems

Microservices

Terraform

Docker

Kubernetes

AWS

EKS

AI/ML platforms

CI/CD

Observability

Education

Formal software engineering training

Tools

Kubeflow

MLflow

PyTorch

TensorFlow

Go

Job description

JPMorgan Chase in Wilmington, DE requires a Senior Lead Software Engineer to design, build, and operate scalable AI/ML platform infrastructure for data scientists and ML engineers. You will lead reliability, scalability, and automation across cloud-native environments in AWS and other clouds, with a focus on GPU workloads and production-grade services.

The role emphasizes platform tooling, IaC, CI/CD, and observability, partnering with cross-functional teams to enable rapid experimentation,