AI/ML Platform Engineer: Scale ML Delivery & Governance

JP Morgan Chase; Jersey City (NJ); On-site; USD 120,000 - 180,000; Full time

Job summary

JPMorgan Chase in Jersey City seeks a Software Engineer III to help accelerate machine learning delivery across our data platforms. You will build and enhance platform capabilities for model registries, data processing, governance tooling, and scalable microservices.

You will collaborate with engineers, data scientists, product managers, and researchers to deliver reliable, secure platform services using AI-assisted development tools and modern architectures.

Qualifications

• Formal training or certification on software engineering concepts and 3+ years applied experience.
• Experience with modern architecture patterns (such as microservices, reactive architectures, event-driven architectures)
• Experience deploying large language model-powered solutions using prompt design, agent workflows, retrieval-augmented generation
• Programming experience in at least two modern languages or frameworks (such as Python, Java, JavaScript, React, Node.js)
• Experience building and consuming RESTful APIs and tuning performance in large-scale applications
• Experience with cloud platforms and containerization or orchestration (such as Docker and Kubernetes)
• Experience with relational and non-relational databases (such as PostgreSQL, MongoDB, Redis, Elasticsearch, Cassandra)
• Experience with engineering practices including refactoring, design patterns, test-driven development, continuous integration and delivery, and application security
• Hands-on experience using company-approved AI-assisted software development tools, with the ability to validate and refine outputs for correctness, performance, and security

Responsibilities

• Build and enhance platform capabilities for model registries, feature registries, promotion policies, and governance tooling
• Design and deliver services for data preparation, annotation workflows, lineage, and auditability
• Develop cloud-native microservices and APIs to support scalable model delivery and operations
• Create large language model-powered capabilities (prompt design, agent workflows, retrieval) to deliver grounded, reliable outcomes
• Produce architecture and design artifacts and ensure implementations meet performance, resiliency, and security constraints
• Use company-approved AI-assisted development tools to improve quality and speed, validating outputs via reviews, testing, and secure coding practices
• Analyze telemetry and user feedback; build reporting and metrics to drive continuous improvement
• Identify hidden issues and patterns in systems and data; improve code health, observability, and platform architecture

Skills

Software engineering concepts

Microservices

LLM-based development

Python/Java/JavaScript

RESTful APIs

Cloud platforms & containers

Databases

CI/CD & security

AI-assisted development tools

Tools

Docker

Kubernetes

React

Node.js

Job description

JPMorgan Chase in Jersey City seeks a Software Engineer III to help accelerate machine learning delivery across our data platforms. You will build and enhance platform capabilities for model registries, data processing, governance tooling, and scalable microservices.

You will collaborate with engineers, data scientists, product managers, and researchers to deliver reliable, secure platform services using AI-assisted development tools and modern architectures.