Senior AI/ML Architect: Production LLM & Conversational Systems

JPMorgan Chase & Co.; Palo Alto (CA); On-site; USD 260,000 - 340,000; Full time

Job summary

JPMorgan Chase & Co. in Palo Alto seeks an Executive Director and Senior Principal Engineer for Applied AI/ML to build production search, conversational AI, and agentic workflow systems.

This hands-on role focuses on architecture and implementation with no people management responsibilities. You will lead design decisions across retrieval strategies, agent design, orchestration patterns, and scalable backend pipelines, collaborating with product and business stakeholders to deliver high-impact

Qualifications

• 10+ years of hands-on software engineering experience building production systems at scale, with deep focus on AI/ML, search, or workflow automation.
• Expert-level proficiency in Python, distributed systems, API design, and microservices architecture.
• Strong understanding of LLM capabilities, prompt engineering, context handling, and using models as components without training.
• Deep experience with retrieval systems, conversational AI, or agentic architectures across multiple areas.

Responsibilities

• Architect, design, and implement production-grade search, chatbot, and agentic workflow systems, coding daily.
• Serve as senior technical authority on LLM-powered applications, owning retrieval, agent design, orchestration, and system architecture decisions.
• Design scalable retrieval pipelines (hybrid search, re-ranking, chunking, embeddings) and conversational AI with robust dialogue management.
• Design and implement agentic workflows (tool use, multi-step planning, orchestration, error recovery, human-in-the-loop).
• Address latency, reliability, observability, and non-deterministic system challenges.

Skills

Python

LLM

Distributed systems

APIs

Microservices

AWS

Tools

AWS

Job description

JPMorgan Chase & Co. in Palo Alto seeks an Executive Director and Senior Principal Engineer for Applied AI/ML to build production search, conversational AI, and agentic workflow systems.

This hands-on role focuses on architecture and implementation with no people management responsibilities. You will lead design decisions across retrieval strategies, agent design, orchestration patterns, and scalable backend pipelines, collaborating with product and business stakeholders to deliver high-impact