Lead AI Agent Platform Engineer – SDK & Tools

Next Frontier Capital; Palo Alto (CA); On-site; USD 180,000 - 240,000; Full time

Job summary

JPMorganChase is seeking a Lead Software Engineer for the AI Agent Platform within Enterprise Technology, AI and Machine Learning & Data Platforms. You will architect and deliver the SDK and platform capabilities to enable large-language-model powered agents at scale, including orchestration, retrieval, memory, and safety features.

You will collaborate with product and stakeholder groups to deliver measurable outcomes and drive improvements across NL2SQL, RAG, and agent memory while maintaining

Qualifications

• Formal training or certification on applied AI and 5+ years experience.

Responsibilities

• Lead end-to-end delivery of the AI Agent Platform SDK and frameworks—from problem framing and technical design through production deployment, scaling, and monitoring that engineering teams use to build, evaluate, and operate AI agents.
• Own core platform services and reusable building blocks: agent orchestration, tool/function calling, retrieval-augmented generation pipelines, and model-serving integration.
• Build and operate first-class agent modalities on the platform, including voice agents (speech-to-text, text-to-speech, low-latency streaming, and turn-taking), document-extraction agents (parsing, OCR, structured field and table extraction from complex documents), and agentic memory (short- and long-term memory, persistence, retrieval, and context management across sessions).
• Drive systematic hill-climbing of core agent capabilities—including NL2SQL, RAG, voice, document extraction, and tool use—by building evaluation datasets, benchmarks, and quality metrics, then iterating on prompts, retrieval, and orchestration to measurably improve accuracy.
• Establish engineering standards through hands-on system design, rigorous code review, and mentorship to improve reliability, maintainability, latency, and developer experience for teams building on the SDK.
• Build and operationalize evaluation, testing, and observability capabilities (offline eval harnesses, regression suites, tracing, latency and cost telemetry, logs, and analytics) to continuously improve solution quality.
• Implement robust safety and governance patterns—guardrails, content filtering, prompt-injection defenses, access controls, and audit-ready operational practices aligned to enterprise expectations.
• Partner with product managers and stakeholders to shape the roadmap, define success metrics (capability accuracy, adoption, task completion, quality), and prioritize work that delivers measurable business impact.
• Drive cross-functional alignment across engineering, data, security, and risk partners to ensure the platform is secure, stable, performant, and scalable.
• Contribute to technical documentation, SDK references, reference implementations, and enablement content that accelerates adoption and responsible usage.

Skills

Applied AI experience

Python proficiency

ML/LLM deployment

Prompt engineering

Technical leadership

Service reliability

Communication

Tools

Docker

Kubernetes

LangGraph

LlamaIndex

Google ADK

AWS

Databricks

Job description

JPMorganChase is seeking a Lead Software Engineer for the AI Agent Platform within Enterprise Technology, AI and Machine Learning & Data Platforms. You will architect and deliver the SDK and platform capabilities to enable large-language-model powered agents at scale, including orchestration, retrieval, memory, and safety features.

You will collaborate with product and stakeholder groups to deliver measurable outcomes and drive improvements across NL2SQL, RAG, and agent memory while maintaining