Senior AI Software Engineering Lead

JPMorganChase

Jersey City (NJ)

On-site

USD 140,000 - 190,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

JPMorganChase is seeking a Senior AI Application Engineer to lead a team of engineers in building production AI agents on NEO, the firm’s agent runtime on AWS/Azure. You will design, productionize, and operate LLM-powered agents, partnering with product and engineering teams in a fast-paced environment.

The role requires deep expertise in Kubernetes, ML, and data management, with responsibilities spanning from prototype to production and strong emphasis on security, scalability, and governance.

Qualifications

  • Formal training or certification on software engineering concepts and 5+ years applied experience.
  • 2+ years of experience leading technologists to manage and solve complex technical items.
  • Hands-on experience delivering system design, application development, testing, and operational stability.

Responsibilities

  • Provide direction, oversight, and coaching for a team of engineers.
  • Make decisions influencing resources, budget, and execution of processes.
  • Design and ship production agents on NEO across the federated portfolio.
  • Build retrieval systems with Graph RAG, vector search, and grounding strategies.
  • Design memory architectures (episodic/semantic) for agent memory and recall policy.
  • Own context management ensuring agents see only allowed data.
  • Compose multi-agent workflows using A2A and MCP; integrate tools (Bitbucket, Confluence, Databricks, Kubernetes, Snowflake, Splunk).
  • Build and run evaluations, regressions, and safety gating before release.
  • Deploy and operate solutions on AWS/Azure with strong SDLC, security, resiliency, observability.
  • Partner with product/business on use cases; translate to shipped agents.

Skills

Python programming
LLM production
Kubernetes
AWS
Azure
Data modeling
RAG systems
Distributed systems
Team leadership

Education

MS in Computer Science

Tools

Bitbucket
Confluence
Databricks
Snowflake
Splunk

Job description

JPMorganChase is seeking a Senior AI Application Engineer to lead a team of engineers in building production AI agents on NEO, the firm’s agent runtime on AWS/Azure. You will design, productionize, and operate LLM-powered agents, partnering with product and engineering teams in a fast-paced environment.

The role requires deep expertise in Kubernetes, ML, and data management, with responsibilities spanning from prototype to production and strong emphasis on security, scalability, and governance.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior AI Agent Engineer - Production LLMs on NEO
Senior AI Agent Engineer - Production LLMs on NEO

JPMorgan Chase & Co. • Jersey City (NJ)

On-site
USD 150,000 - 190,000
Senior AI/ML Engineer Lead — Production LLM & Multi-Agent
Senior AI/ML Engineer Lead — Production LLM & Multi-Agent

JP Morgan Chase • Jersey City (NJ)

Hybrid
USD 180,000 - 240,000
Senior ML Engineer & Tech Lead: Agent Platform (NEO)
Senior ML Engineer & Tech Lead: Agent Platform (NEO)

JP Morgan Chase • Jackson (TN)

On-site
USD 150,000 - 210,000
Senior AI Production Architect & Lead Engineer
Senior AI Production Architect & Lead Engineer

JP Morgan Chase • Columbus (OH)

On-site
USD 140,000 - 190,000
Total rewards package
Health care coverage
On-site health and wellness centers
+5
Senior Lead Software Engineer - AI Agentic Platforms
Senior Lead Software Engineer - AI Agentic Platforms

JP Morgan Chase • Jersey City (NJ)

On-site
USD 170,000 - 250,000
Senior AI Platform Engineer - LLM & Production ML
Senior AI Platform Engineer - LLM & Production ML

JP Morgan Chase • Jersey City (NJ)

On-site
USD 180,000 - 260,000
Senior Lead AI/ML Engineer for Production Agents
Senior Lead AI/ML Engineer for Production Agents

JPMorgan Chase • Jersey City (NJ)

On-site
USD 180,000 - 240,000
Lead AI Agent Platform Engineer
Lead AI Agent Platform Engineer

JP Morgan Chase • New York (NY)

On-site
USD 150,000 - 190,000
Senior Lead AI/Agentic Software Engineer
Senior Lead AI/Agentic Software Engineer

Aumni • Plano (TX)

On-site
USD 140,000 - 210,000
Health care coverage
On-site wellness centers
Retirement savings plan
+4
Senior ML Engineer, Agent Platform & Runtime
Senior ML Engineer, Agent Platform & Runtime

JP Morgan Chase • Jersey City (NJ)

On-site
USD 140,000 - 210,000