Principal AI Foundations Engineer - Platform & MLOps

J.P. Morgan; New York (NY); On-site; USD 120,000 - 190,000; Full time

Job summary

JPMorganChase is seeking a Principal Software Engineer in New York to lead AI-enabled product development within the Chief Data and Analytics Office. You will design scalable AI services, own SDKs, and drive end-to-end ML pipelines in a secure, production-ready environment.

You will influence senior technical leaders, contribute to distributed training techniques, and build durable platform components to accelerate delivery and ensure reliability across multiple portfolios.

Qualifications

• Formal training or certification on software engineering concepts and 7+ years applied experience.
• Hands-on experience delivering system design, application development, testing, and operational stability for large-scale platforms and services.
• Expert proficiency in one or more programming languages (e.g., Python, Java, Scala, Go) with strong code quality, testing, and debugging practices.
• Demonstrated experience designing and leading adoption of agentic AI-enabled development practices across teams, including setting standards for human-in-the-loop validation, auditability/traceability of changes, and secure handling of sensitive data.
• Strong understanding of responsible AI use and control expectations in engineering workflows, including security/resiliency implications, data sensitivity, and risk-based governance; ability to influence senior technical leaders on safe scaling patterns and reuse.

Responsibilities

• Design, build, and troubleshoot AI-enabled applications and AI services, delivering scalable solutions.
• Develop secure, high-quality production code; review and improve code written by others.
• Own and support SDK and service integrations, ensuring reliability and performance.
• Build and ship AI-powered features including prompt design and SDK/REST integrations.
• Design and implement end-to-end MLOps capabilities including data/model versioning and CI/CD for models.
• Contribute to next-generation training techniques and productize into platform primitives.
• Identify recurring issues and automate remediation to improve reliability and performance.
• Create reusable frameworks and platform components for cross-team use.
• Influence leaders to drive alignment and outcomes and foster inclusion and respect.
• Architect and govern agentic AI-enabled workflows with guardrails for security and reuse.

Skills

Python

Java

Scala

Go

AI/ML platforms

Cloud native

Distributed systems

Communication

Leadership

Education

Formal software engineering training/certification

Tools

Docker

Kubernetes

Terraform

CI/CD tooling

ML tooling

Job description

JPMorganChase is seeking a Principal Software Engineer in New York to lead AI-enabled product development within the Chief Data and Analytics Office. You will design scalable AI services, own SDKs, and drive end-to-end ML pipelines in a secure, production-ready environment.

You will influence senior technical leaders, contribute to distributed training techniques, and build durable platform components to accelerate delivery and ensure reliability across multiple portfolios.