Senior AI/ML Platform Engineer: Scale ML Delivery

Worky; Jersey City (NJ); On-site; USD 110,000 - 160,000; Full time

Job summary

JPMorgan Chase in Jersey City seeks Software Engineer III to help accelerate the ML lifecycle, spanning model ops, data prep, and governance tooling. You will collaborate with engineers, data scientists, and product managers to deliver reliable, secure platform services across the ML lifecycle.

You will build cloud-native microservices and REST APIs, work with Docker/Kubernetes, and leverage databases like PostgreSQL and MongoDB.

Qualifications

• Formal training or certification on software engineering concepts and 3+ years applied experience.
• Experience with modern architecture patterns (microservices, reactive, event-driven).
• Experience developing and deploying large language model-powered solutions using prompts, workflows, and retrieval.
• Programming in at least two modern languages/frameworks (Python, Java, JavaScript, React, Node.js).
• Experience building RESTful APIs and tuning performance in large-scale apps.
• Experience with cloud platforms and containerization (Docker and Kubernetes).
• Experience with relational and non-relational databases (PostgreSQL, MongoDB, Redis, Elasticsearch, Cassandra).
• Engineering practices: refactoring, design patterns, TDD, CI/CD, and security.
• Hands-on with AI-assisted software development tools; validate outputs for correctness, performance, and security.

Responsibilities

• Build and enhance platform capabilities for model registries and governance tooling.
• Design services for data preparation, annotation workflows, lineage, and auditability.
• Develop cloud-native microservices and APIs for scalable model delivery.
• Create LLM-powered capabilities (prompt design, agent workflows, retrieval) for reliable outcomes.
• Produce architecture and design artifacts; ensure performance, resiliency, and security.
• Use AI-assisted development tools; validate outputs via reviews, testing, and secure coding practices.
• Analyze telemetry and user feedback; build reporting and metrics for continuous improvement.
• Identify hidden issues in systems and data; improve code health, observability, and platform architecture.

Skills

Microservices

REST APIs

Docker

Kubernetes

Python

Java

JavaScript

React

CI/CD

Security

Data governance

PostgreSQL

MongoDB

Redis

Elasticsearch

Cassandra

Tools

PostgreSQL

MongoDB

Redis

Elasticsearch

Cassandra

Job description

JPMorgan Chase in Jersey City seeks Software Engineer III to help accelerate the ML lifecycle, spanning model ops, data prep, and governance tooling. You will collaborate with engineers, data scientists, and product managers to deliver reliable, secure platform services across the ML lifecycle.

You will build cloud-native microservices and REST APIs, work with Docker/Kubernetes, and leverage databases like PostgreSQL and MongoDB.