ML Platform Engineer II: Scalable AI Delivery & Governance

Worky; Jersey City (NJ); On-site; USD 110,000 - 160,000; Full time

Job summary

JPMorgan Chase is seeking an Software Engineer II to help build platform capabilities for the ML lifecycle, including model and feature registries, data preparation, and governance tooling. You will design cloud-native microservices and RESTful APIs to support scalable model delivery and operations.

You will collaborate with engineers, product managers, data scientists, and researchers to ensure secure, reliable, and observable platform services with strong emphasis on security practices and

Qualifications

• Formal training or certification on software engineering concepts and 2+ years applied experience.
• Experience with modern architecture patterns (microservices, reactive architectures, event-driven architectures).
• Experience developing and deploying large language model-powered solutions using prompt design, agent workflows, tool integration, and retrieval-augmented generation.
• Programming experience in two or more modern languages or frameworks (Python, Java, JavaScript, React, Node.js).
• Experience building and consuming RESTful APIs and tuning performance in large-scale applications.
• Experience with cloud platforms and containerization/orchestration (Docker/Kubernetes).
• Experience with relational and non-relational databases (PostgreSQL, MongoDB, Redis, Elasticsearch, Cassandra).
• Experience with engineering practices including refactoring, design patterns, test-driven development, CI/CD, and application security.

Responsibilities

• Build and enhance platform capabilities for model registries, feature registries, promo policies, and governance tooling.
• Design and deliver services for data preparation, annotation workflows, lineage, and auditability.
• Develop cloud-native microservices and APIs to support scalable model delivery and operations.
• Create large language model-powered capabilities (prompt design, agent workflows, retrieval) to deliver grounded outcomes.
• Produce architecture and design artifacts and ensure implementations meet performance, resiliency, and security constraints.
• Use company-approved AI-assisted development tools to improve quality and speed, validating outputs via reviews, testing, and secure coding practices.
• Analyze telemetry and user feedback; build reporting and metrics to drive continuous improvement.
• Identify hidden issues and patterns in systems and data; improve code health, observability, and platform architecture.

Skills

Python

Java

REST APIs

Docker/Kubernetes

Microservices

Cloud platforms

CI/CD

Data governance

Security practices

AI tooling

Tools

Docker

Kubernetes

PostgreSQL

MongoDB

Elasticsearch

AWS

CI/CD tools

Job description

JPMorgan Chase is seeking an Software Engineer II to help build platform capabilities for the ML lifecycle, including model and feature registries, data preparation, and governance tooling. You will design cloud-native microservices and RESTful APIs to support scalable model delivery and operations.

You will collaborate with engineers, product managers, data scientists, and researchers to ensure secure, reliable, and observable platform services with strong emphasis on security practices and