Senior AI/ML Platform Engineer — Cloud Infra & Pipelines

JP Morgan Chase; Jersey City (NJ); On-site; USD 140,000 - 210,000; Full time

Job summary

JPMorganChase is seeking a Senior Lead Software Engineer to shape the AI/ML platform that powers data science and model deployment across the firm. You will design, build, and operate foundational cloud infrastructure, enabling scalable, secure, and production-grade AI workloads.

You will lead efforts to improve platform reliability, performance, and automation while collaborating with cross-functional teams to translate model and compute requirements into deployment patterns.

Qualifications

• Formal training or certification in software engineering, with 5+ years of applied experience.
• Proven production-quality Python or Java code delivery.
• Strong background in distributed systems, microservices and platform design.
• Experience architecting cloud-native infra on AWS and other clouds.
• Hands-on with Terraform, Docker, Kubernetes and EKS operations.
• Experience with production AI/ML platforms and GPU infrastructure tooling.
• Solid DevOps practices: CI/CD, automated testing, observability.
• Strong Linux, scripting and networking fundamentals.
• Knowledge of responsible AI use and secure coding standards.

Responsibilities

• Builds and maintains reusable AI/ML platform infrastructure and shared services at scale.
• Architects and operates secure cloud and container-based environments for training and inference.
• Designs tooling for deployment, provisioning, release management, and support.
• Develops production-grade services, APIs, and workflows for model lifecycles.
• Collaborates across data science and application teams to standardize deployments.
• Optimizes reliability, scalability, latency, and cost through orchestration and hardware acceleration.
• Establishes monitoring, logging, access controls, incident response, and troubleshooting.
• Supports enterprise AI operationalization, including fine-tuning workflows and eval.
• Drives adoption of AI-assisted engineering practices and promotes reuse of patterns.
• Applies SDLC tooling knowledge to improve automation value at scale.

Skills

Python/Java development

Distributed systems

Cloud-native infrastructure

DevOps / CI/CD

AI/ML platform experience

Education

Formal training or certification in software engineering

Tools

Terraform

Docker

Kubernetes

AWS EKS

Job description

JPMorganChase is seeking a Senior Lead Software Engineer to shape the AI/ML platform that powers data science and model deployment across the firm. You will design, build, and operate foundational cloud infrastructure, enabling scalable, secure, and production-grade AI workloads.

You will lead efforts to improve platform reliability, performance, and automation while collaborating with cross-functional teams to translate model and compute requirements into deployment patterns.