Senior Lead AI Platform Engineer - LLM & Cloud-Native

JPMorgan Chase & Co.; Jersey City (NJ); On-site; USD 150,000 - 190,000; Full time

Job summary

JPMorgan Chase & Co. is seeking a Senior Lead Software Engineer within the AI/ML Data Platforms team in Jersey City to lead engineering efforts, design scalable cloud-native services on AWS, and build agentic AI platforms for enterprise use cases.

You will drive architecture decisions, oversee production-grade LLM applications, and promote responsible AI practices while collaborating across product, risk, and compliance teams.

Qualifications

• 5+ years of software engineering experience with a formal training or certification.
• Strong Python proficiency with PyTorch or TensorFlow.
• Proven track record deploying LLM-backed services to production (APIs, microservices).
• Deep MLOps experience including CI/CD, monitoring, incident response, and model governance.
• Cloud-native AI deployment on AWS or Azure with cost/performance optimization.
• Commitment to responsible AI practices and operational excellence.
• Ability to influence senior technical leaders on safe scaling patterns and reuse.

Responsibilities

• Provide technical guidance to business and engineering teams and align on priorities.
• Develop secure, high-quality production code and lead code reviews.
• Drive architecture decisions influencing product design and operations.
• Lead adoption of agentic AI-enabled development practices across teams.
• Build and operate production-grade LLM applications and tool integrations.
• Design cloud-native services on AWS with scalable, resilient architectures.
• Implement retrieval-augmented generation (RAG) and semantic search utilities.
• Ensure secure handling of data and auditability across engineering workflows.

Skills

Python engineering

PyTorch

TensorFlow

LLM deployment

MLOps

AWS

Azure

responsible AI

communication

architecture leadership

Job description

JPMorgan Chase & Co. is seeking a Senior Lead Software Engineer within the AI/ML Data Platforms team in Jersey City to lead engineering efforts, design scalable cloud-native services on AWS, and build agentic AI platforms for enterprise use cases.

You will drive architecture decisions, oversee production-grade LLM applications, and promote responsible AI practices while collaborating across product, risk, and compliance teams.