Lead AI Platform Engineer — Agent SDK & Orchestration

Fairygodboss; Jersey City (NJ); On-site; USD 180,000 - 260,000; Full time

Job summary

JPMorganChase is seeking a senior engineer to lead the AI Agent Platform, shaping SDKs, orchestration frameworks, and reusable components that empower teams across the firm to build agent-based experiences.

You will own core platform services, drive reliability, performance, and security, and mentor engineers while partnering with product managers to deliver measurable business impact on NL2SQL, RAG, and document-processing capabilities.

Qualifications

• 5+ years of applied AI/ML experience with formal training.
• Advanced Python and strong software engineering fundamentals.
• Experience deploying ML/LLM systems to production.
• Prompt engineering and retrieval-augmented generation knowledge.
• Designing reliable services with incident response readiness.
• Ability to lead technical decisions and mentor others.
• Strong cross-functional communication skills.

Responsibilities

• Deliver AI Agent Platform SDK and frameworks from design to production deployment.
• Own services like orchestration, tool calling, RAG pipelines, and model-serving integration.
• Build agent modalities: voice agents, document-extraction, and agent memory.
• Improve NL2SQL, RAG, voice, and document-extraction capabilities with benchmarks.
• Establish engineering standards and mentorship for reliability and latency.
• Develop testing, observability, and governance capabilities for enterprise use.
• Collaborate with product managers to shape roadmap and success metrics.
• Ensure security, stability, and scalability across teams.
• Contribute to documentation, SDK references, and enablement content.

Skills

Python

AI/ML concepts

ML in production

Prompt engineering

System design

Technical leadership

Communication

Education

AI/ML certification

Tools

Docker

Kubernetes

LangGraph

LlamaIndex

Google ADK

Job description

JPMorganChase is seeking a senior engineer to lead the AI Agent Platform, shaping SDKs, orchestration frameworks, and reusable components that empower teams across the firm to build agent-based experiences.

You will own core platform services, drive reliability, performance, and security, and mentor engineers while partnering with product managers to deliver measurable business impact on NL2SQL, RAG, and document-processing capabilities.