Senior AI Foundations Engineer - Scalable ML & MLOps

JPMorgan Chase & Co.; Jersey City (NJ); On-site; USD 180,000 - 240,000; Full time

Job summary

JPMorgan Chase & Co. in Jersey City, NJ, is seeking a Principal Software Engineer to join the Chief Data and Analytics Office. You will provide engineering excellence on an agile team to deliver trusted technology products in a secure, scalable way.

You will design AI-enabled applications, lead ML/LLM platform efforts, and drive end-to-end MLOps, data/versioning, and production readiness across portfolios. The role emphasizes collaboration with senior stakeholders, governance of AI workflows,

Qualifications

• Formal training or certification on software engineering concepts and 7+ years applied experience.
• Hands-on experience delivering system design, application development, testing, and operational stability for large-scale platforms and services.
• Expert proficiency in one or more programming languages (e.g., Python, Java, Scala, Go) with strong code quality, testing, and debugging practices.
• Demonstrated experience designing and leading adoption of agentic AI-enabled development practices across teams, including setting standards for human-in-the-loop validation and secure data handling.
• Strong understanding of responsible AI use and control expectations in engineering workflows, including security/resiliency implications and risk-based governance.
• Proven ability to design and operate ML/LLM platforms: reproducible training pipelines, experiment tracking, model/data versioning.
• Practical cloud-native experience (containers, orchestration, IaC, observability) and operating production systems with clear SLOs.
• Experience applying new methods to solve complex technology problems across platform engineering, ML systems, data engineering, distributed systems.
• Strong communications skills: ability to present to and influence senior leaders/executives.

Responsibilities

• Design, build, and troubleshoot AI-enabled applications and AI services, delivering scalable solutions.
• Develop secure, high-quality production code; review, debug, and improve code.
• Own and support SDK and service integrations, ensuring reliability and performance.
• Build and ship AI-powered features, including prompt design and SDK/REST integrations.
• Design and implement end-to-end MLOps capabilities including data/model versioning and CI/CD for models.
• Contribute to next-generation training techniques and productize them into platform primitives.
• Automate remediation to improve reliability, resiliency, and operational performance.

Skills

Python/Java/Scala/Go

Agentic AI development

Cloud-native / IaC / containers

Strong communication

Platform engineering / ML systems

Tools

Kubernetes

CI/CD tooling

Ray

Job description

JPMorgan Chase & Co. in Jersey City, NJ, is seeking a Principal Software Engineer to join the Chief Data and Analytics Office. You will provide engineering excellence on an agile team to deliver trusted technology products in a secure, scalable way.

You will design AI-enabled applications, lead ML/LLM platform efforts, and drive end-to-end MLOps, data/versioning, and production readiness across portfolios. The role emphasizes collaboration with senior stakeholders, governance of AI workflows,