Lead AI Agent Platform Engineer

J.P. Morgan; New York (NY); On-site; USD 150,000 - 190,000; Full time

Job summary

JPMorganChase seeks a Lead Software Engineer for the AI Agent Platform. You will shape the SDK, orchestration, and reusable components powering enterprise agent experiences across teams and thousands of users.

You will drive design, tooling, grounding, and memory modules, with a focus on NL2SQL, RAG, and robust safety. Leadership and collaboration with product, data, and security teams are essential to delivering measurable business impact.

Qualifications

• Formal AI/ML training or certification required.
• 5+ years applying AI/ML to production systems.
• Strong Python, testing, and design-pattern skills.
• Experience with prompt engineering and retrieval methods.
• Ability to lead decisions and communicate trade-offs clearly.

Responsibilities

• Lead end-to-end delivery of the AI Agent Platform SDK and frameworks from design to production.
• Own core platform services: orchestration, tool calling, and RAG pipelines.
• Build voice agents, document extraction, and agent memory capabilities.
• Establish standards, code reviews, and mentorship to improve reliability.
• Develop evaluation, testing, observability, and safety patterns at scale.

Skills

Python programming

ML systems deployment

Prompt engineering

System design

Leadership

Communication

Education

Formal AI/ML training or certification

Tools

Docker

Kubernetes

LangGraph

LlamaIndex

cloud platforms

Job description

JPMorganChase seeks a Lead Software Engineer for the AI Agent Platform. You will shape the SDK, orchestration, and reusable components powering enterprise agent experiences across teams and thousands of users.

You will drive design, tooling, grounding, and memory modules, with a focus on NL2SQL, RAG, and robust safety. Leadership and collaboration with product, data, and security teams are essential to delivering measurable business impact.