Senior AI Platform Engineer — Cloud, GPUs & MLOps

JPMorgan Chase & Co.; Fairfax (DE); Hybrid; USD 140,000 - 200,000; Full time

Job summary

JPMorgan Chase & Co. is seeking a Lead Software Engineer on the Corporate - AIML Data Platforms team to design, build, and operate scalable cloud infrastructure for data scientists and ML engineers.

You will lead platform reliability, automation, and cross-functional collaboration across the firm to accelerate AI/ML capabilities and production-grade deployments. You will architect container-based environments on AWS, implement IaC with Terraform, and drive CI/CD, monitoring, and security

Qualifications

• Formal training or certification on software engineering concepts.
• 5+ years applied experience in software development or platform engineering.
• Experience delivering secure, production-quality code.

Responsibilities

• Builds and maintains reusable AI/ML platform infrastructure and shared services to support development, deployment, and operations at scale.
• Architects, deploys, and operates secure cloud and container-based environments for training and inference, including GPU-intensive workloads.
• Design and implement platform tooling, automation, and infrastructure-as-code solutions to streamline model deployment, environment provisioning, release management, and operational support.
• Develops and maintains production-grade services, APIs, SDK integrations, and workflows that support model training, serving, evaluation pipelines, and AI application lifecycle management.
• Partners with data science, ML engineering, and application teams to translate model and compute requirements into platform standards and deployment patterns.
• Optimizes platform reliability, scalability, latency, and cost through orchestration, scheduling, and hardware acceleration.
• Establishes operational best practices including monitoring, logging, observability, access controls, incident response, and production troubleshooting.
• Supports enterprise LLM operationalization, including fine-tuning workflows, inference drives and AI-assisted engineering practices while establishing validation standards.
• Applies knowledge of tools within the Software Development Life Cycle toolchain to improve automation value.

Skills

Python

Java

Distributed systems

Microservices

Platform architecture

AWS

Terraform

Docker

Kubernetes

AWS EKS

CI/CD

Observability

SQL/NoSQL

Linux

Scripting

Networking fundamentals

AI-assisted software development tools

Responsible AI practices

Education

Software engineering training/certification

Tools

Terraform

Docker

Kubernetes

AWS EKS

Kubeflow

MLflow

PyTorch

TensorFlow

Job description

JPMorgan Chase & Co. is seeking a Lead Software Engineer on the Corporate - AIML Data Platforms team to design, build, and operate scalable cloud infrastructure for data scientists and ML engineers.

You will lead platform reliability, automation, and cross-functional collaboration across the firm to accelerate AI/ML capabilities and production-grade deployments. You will architect container-based environments on AWS, implement IaC with Terraform, and drive CI/CD, monitoring, and security