Software Engineer II

J.P. Morgan; Jersey City (NJ); On-site; USD 110,000 - 170,000; Full time

Job summary

JPMorgan Chase is seeking a Software Engineer II within the Corporate Artificial Intelligence and Machine Learning Data Platforms team to build platform capabilities that accelerate moving from ideas to production with confidence. You will contribute to scalable ML lifecycles and governance tooling, spanning model ops, data development, and security-focused tooling.

You will collaborate closely with engineers, product managers, data scientists, and researchers to deliver reliable, secure

Qualifications

• Formal training or certification on software engineering concepts and 2+ years applied experience.
• Experience with modern architecture patterns (microservices, reactive, event-driven).
• Experience developing and deploying LLM-powered solutions using prompt design and retrieval.
• Programming in Python, Java, or JavaScript; RESTful APIs; performance tuning at scale.
• Cloud platforms and containerization (Docker, Kubernetes); databases (SQL/NoSQL).
• Engineering practices: refactoring, design patterns, TDD, CI/CD, security.

Responsibilities

• Build and enhance platform capabilities for model registries, feature registries, promotion policies, and governance tooling
• Design and deliver services for data preparation, annotation workflows, lineage, and auditability
• Develop cloud-native microservices and APIs to support scalable model delivery and operations
• Create LLM-powered capabilities (prompt design, agent workflows, retrieval) for grounded outcomes
• Produce architecture and design artifacts; ensure performance, resiliency, and security
• Use AI-assisted development tools; validate outputs via reviews, testing, and secure coding
• Analyze telemetry and user feedback; build reporting and metrics for improvement
• Identify hidden issues and patterns; improve code health, observability, platform

Skills

Software engineering

Microservices

REST APIs

CI/CD

AI tooling

Programming languages

Tools

Docker

Kubernetes

PostgreSQL

MongoDB

Job description

Join a team where your engineering work accelerates how machine learning is built, governed, and delivered across JPMorgan Chase. You will help create platform capabilities that make it easier for teams to move from ideas to production with confidence. If you enjoy building scalable systems and improving developer experience, this role offers meaningful impact and career growth.

As a Software Engineer II at JPMorgan Chase within the Corporate Artificial Intelligence and Machine Learning Data Platforms team, you will build and enhance products that support the machine learning lifecycle—spanning model operations, data development (such as processing and data annotation), and governance tooling. You will collaborate closely with engineers, system architects, product managers, data scientists, and research partners to deliver reliable, secure, and user-friendly platform services.

Job responsibilities

• Build and enhance platform capabilities for model registries, feature registries, promotion policies, and governance tooling
• Design and deliver services for data preparation, annotation workflows, lineage, and auditability
• Develop cloud-native microservices and application programming interfaces to support scalable model delivery and operations
• Create large language model-powered capabilities (prompt design, agent workflows, retrieval) to deliver grounded, reliable outcomes
• Produce architecture and design artifacts and ensure implementations meet performance, resiliency, and security constraints
• Use company-approved AI-assisted development tools to improve quality and speed, validating outputs via reviews, testing, and secure coding practices
• Analyze telemetry and user feedback; build reporting and metrics to drive continuous improvement
• Identify hidden issues and patterns in systems and data; improve code health, observability, and platform architecture

Required qualifications, capabilities, and skills

• Formal training or certification on software engineering concepts and 2+ years applied experience
• Experience with modern architecture patterns (such as microservices, reactive architectures, event-driven architectures)
• Experience developing and deploying large language model-powered solutions using prompt design, agent workflows, tool integration, and retrieval-augmented generation
• Programming experience in at least two modern languages or frameworks (such as Python, Java, JavaScript, React, Node.js)
• Experience building and consuming RESTful application programming interfaces and tuning performance in large-scale applications
• Experience with cloud platforms and containerization or orchestration (such as Docker and Kubernetes)
• Experience with relational and non-relational databases (such as PostgreSQL, MongoDB, Redis, Elasticsearch, Cassandra)
• Experience with engineering practices including refactoring, design patterns, test-driven development, continuous integration and delivery, and application security
• Hands‑on experience using company-approved AI‑assisted software development tools, with the ability to validate and refine outputs for correctness, performance, and security

Preferred qualifications, capabilities, and skills

• Experience with HTML and CSS and at least one modern JavaScript framework (such as React, Vue, or Angular)
• Experience or knowledge of model governance and data governance
• Experience building internal platforms or developer experience tooling that supports machine learning delivery and operations