Lead AI Engineer for Enterprise LLM Platform

Next Frontier Capital; Palo Alto (CA); On-site; USD 180,000 - 260,000; Full time

Job summary

JPMorganChase in Palo Alto seeks a Lead Software Engineer to drive the architecture and hands-on delivery of scalable LLM-based platforms for enterprise use. You will lead architecture and hands-on implementation, driving reliability, cost efficiency, and developer velocity.

Partner with product and engineering teams to ship reusable capabilities, establish observability standards, and mentor senior engineers while applying responsible AI practices across the platform.

Qualifications

• 5+ years of software engineering experience with formal training or certification.
• Experience architecting and shipping production LLM applications, agentic workflows, and tool integration.
• Strong API design skills and secure integration patterns.
• Mentor engineers and influence cross-functional stakeholders.
• Hands-on use of enterprise AI-assisted development tools with emphasis on correctness and security.
• Understanding of responsible AI use in engineering workflows.

Responsibilities

• Lead architecture and hands-on delivery of scalable AI platforms for enterprise workflows.
• Design production-grade AI systems including agents, skills, memory patterns, and tool-use orchestration.
• Architect retrieval and context-engineering approaches (embeddings, semantic search, grounding, summarization).
• Engineer cloud-native AI services on AWS using containers and serverless patterns.
• Optimize platform performance: latency, throughput, scalability, cost controls.
• Build APIs and integrations connecting AI capabilities to enterprise platforms and processes.
• Establish evaluation and observability frameworks to improve agent behavior.

Skills

LLM architecture

Production systems

API design

Mentoring

AI-assisted development tools

Responsible AI

AWS & serverless

Kubernetes

Tools

AWS

Containers

Serverless

Kubernetes

Job description

JPMorganChase in Palo Alto seeks a Lead Software Engineer to drive the architecture and hands-on delivery of scalable LLM-based platforms for enterprise use. You will lead architecture and hands-on implementation, driving reliability, cost efficiency, and developer velocity.

Partner with product and engineering teams to ship reusable capabilities, establish observability standards, and mentor senior engineers while applying responsible AI practices across the platform.