Software Engineer III - AI/ML Platform Engineer

Worky; Jersey City (NJ); On-site; USD 110,000 - 160,000; Full time

Job summary

JPMorgan Chase in Jersey City seeks Software Engineer III to help accelerate the ML lifecycle, spanning model ops, data prep, and governance tooling. You will collaborate with engineers, data scientists, and product managers to deliver reliable, secure platform services across the ML lifecycle.

You will build cloud-native microservices and REST APIs, work with Docker/Kubernetes, and leverage databases like PostgreSQL and MongoDB.

Qualifications

• Formal training or certification on software engineering concepts and 3+ years applied experience.
• Experience with modern architecture patterns (microservices, reactive, event-driven).
• Experience developing and deploying large language model-powered solutions using prompts, workflows, and retrieval.
• Programming in at least two modern languages/frameworks (Python, Java, JavaScript, React, Node.js).
• Experience building RESTful APIs and tuning performance in large-scale apps.
• Experience with cloud platforms and containerization (Docker and Kubernetes).
• Experience with relational and non-relational databases (PostgreSQL, MongoDB, Redis, Elasticsearch, Cassandra).
• Engineering practices: refactoring, design patterns, TDD, CI/CD, and security.
• Hands-on with AI-assisted software development tools; validate outputs for correctness, performance, and security.

Responsibilities

• Build and enhance platform capabilities for model registries and governance tooling.
• Design services for data preparation, annotation workflows, lineage, and auditability.
• Develop cloud-native microservices and APIs for scalable model delivery.
• Create LLM-powered capabilities (prompt design, agent workflows, retrieval) for reliable outcomes.
• Produce architecture and design artifacts; ensure performance, resiliency, and security.
• Use AI-assisted development tools; validate outputs via reviews, testing, and secure coding practices.
• Analyze telemetry and user feedback; build reporting and metrics for continuous improvement.
• Identify hidden issues in systems and data; improve code health, observability, and platform architecture.

Skills

Microservices

REST APIs

Docker

Kubernetes

Python

Java

JavaScript

React

CI/CD

Security

Data governance

PostgreSQL

MongoDB

Redis

Elasticsearch

Cassandra

Tools

PostgreSQL

MongoDB

Redis

Elasticsearch

Cassandra

Job description

Join a team where your engineering work accelerates how machine learning is built, governed, and delivered across JPMorgan Chase. You will help create platform capabilities that make it easier for teams to move from ideas to production with confidence. If you enjoy building scalable systems and improving developer experience, this role offers meaningful impact and career growth.

As a Software Engineer III at JPMorgan Chase within the Corporate Artificial Intelligence and Machine Learning Data Platforms team, you will build and enhance products that support the machine learning lifecycle—spanning model operations, data development (such as processing and data annotation), and governance tooling. You will collaborate closely with engineers, system architects, product managers, data scientists, and research partners to deliver reliable, secure, and user-friendly platform services.

Job responsibilities

• Build and enhance platform capabilities for model registries, feature registries, promotion policies, and governance tooling
• Design and deliver services for data preparation, annotation workflows, lineage, and auditability
• Develop cloud-native microservices and application programming interfaces to support scalable model delivery and operations
• Create large language model-powered capabilities (prompt design, agent workflows, retrieval) to deliver grounded, reliable outcomes
• Produce architecture and design artifacts and ensure implementations meet performance, resiliency, and security constraints
• Use company-approved AI-assisted development tools to improve quality and speed, validating outputs via reviews, testing, and secure coding practices
• Analyze telemetry and user feedback; build reporting and metrics to drive continuous improvement
• Identify hidden issues and patterns in systems and data; improve code health, observability, and platform architecture

Required qualifications, capabilities, and skills

• Formal training or certification on software engineering concepts and 3+ years applied experience
• Experience with modern architecture patterns (such as microservices, reactive architectures, event-driven architectures)
• Experience developing and deploying large language model-powered solutions using prompt design, agent workflows, tool integration, and retrieval-augmented generation
• Programming experience in at least two modern languages or frameworks (such as Python, Java, JavaScript, React, Node.js)
• Experience building and consuming RESTful application programming interfaces and tuning performance in large-scale applications
• Experience with cloud platforms and containerization or orchestration (such as Docker and Kubernetes)
• Experience with relational and non-relational databases (such as PostgreSQL, MongoDB, Redis, Elasticsearch, Cassandra)
• Experience with engineering practices including refactoring, design patterns, test-driven development, continuous integration and delivery, and application security
• Hands‑on experience using company‑approved AI‑assisted software development tools, with the ability to validate and refine outputs for correctness, performance, and security

Preferred qualifications, capabilities, and skills

• Experience with HTML and CSS and at least one modern JavaScript framework (such as React, Vue, or Angular)
• Experience or knowledge of model governance and data governance
• Experience building internal platforms or developer experience tooling that supports machine learning delivery and operations

JPMorganChase, one of the oldest financial institutions, offers innovative financial solutions to millions of consumers, small businesses and many of the world’s most prominent corporate, institutional and government clients under the J.P. Morgan and Chase brands. Our history spans over 200 years and today we are a leader in investment banking, consumer and small business banking, commercial banking, financial transaction processing and asset management.

We offer a competitive total rewards package including base salary determined based on the role, experience, skill set and location. Those in eligible roles may receive commission-based pay and/or discretionary incentive compensation, paid in the form of cash and/or forfeitable equity, awarded in recognition of individual achievements and contributions. We also offer a range of benefits and programs to meet employee needs, based on eligibility. These benefits include comprehensive health care coverage, on-site health and wellness centers, a retirement savings plan, backup childcare, tuition reimbursement, mental health support, financial coaching and more. Additional details about total compensation and benefits will be provided during the hiring process.

We recognize that our people are our strength and the diverse talents they bring to our global workforce are directly linked to our success. We are an equal opportunity employer and place a high value on diversity and inclusion at our company. We do not discriminate on the basis of any protected attribute, including race, religion, color, national origin, gender, sexual orientation, gender identity, gender expression, age, marital or veteran status, pregnancy or disability, or any other basis protected under applicable law. We also make reasonable accommodations for applicants’ and employees’ religious practices and beliefs, as well as mental health or physical disability needs. Visit our FAQs for more information about requesting an accommodation.

JPMorgan Chase & Co. is an Equal Opportunity Employer, including Disability/Veterans

Our professionals in our Corporate Functions cover a diverse range of areas from finance and risk to human resources and marketing. Our corporate teams are an essential part of our company, ensuring that we’re setting our businesses, clients, customers and employees up for success.