ML Platform Engineer II — Scale ML Delivery

J.P. Morgan; Jersey City (NJ); On-site; USD 110,000 - 170,000; Full time

Job summary

JPMorgan Chase is seeking a Software Engineer II within the Corporate Artificial Intelligence and Machine Learning Data Platforms team to build platform capabilities that accelerate moving from ideas to production with confidence. You will contribute to scalable ML lifecycles and governance tooling, spanning model ops, data development, and security-focused tooling.

You will collaborate closely with engineers, product managers, data scientists, and researchers to deliver reliable, secure

Qualifications

• Formal training or certification on software engineering concepts and 2+ years applied experience.
• Experience with modern architecture patterns (microservices, reactive, event-driven).
• Experience developing and deploying LLM-powered solutions using prompt design and retrieval.
• Programming in Python, Java, or JavaScript; RESTful APIs; performance tuning at scale.
• Cloud platforms and containerization (Docker, Kubernetes); databases (SQL/NoSQL).
• Engineering practices: refactoring, design patterns, TDD, CI/CD, security.

Responsibilities

• Build and enhance platform capabilities for model registries, feature registries, promotion policies, and governance tooling
• Design and deliver services for data preparation, annotation workflows, lineage, and auditability
• Develop cloud-native microservices and APIs to support scalable model delivery and operations
• Create LLM-powered capabilities (prompt design, agent workflows, retrieval) for grounded outcomes
• Produce architecture and design artifacts; ensure performance, resiliency, and security
• Use AI-assisted development tools; validate outputs via reviews, testing, and secure coding
• Analyze telemetry and user feedback; build reporting and metrics for improvement
• Identify hidden issues and patterns; improve code health, observability, platform

Skills

Software engineering

Microservices

REST APIs

CI/CD

AI tooling

Programming languages

Tools

Docker

Kubernetes

PostgreSQL

MongoDB

Job description

JPMorgan Chase is seeking a Software Engineer II within the Corporate Artificial Intelligence and Machine Learning Data Platforms team to build platform capabilities that accelerate moving from ideas to production with confidence. You will contribute to scalable ML lifecycles and governance tooling, spanning model ops, data development, and security-focused tooling.

You will collaborate closely with engineers, product managers, data scientists, and researchers to deliver reliable, secure