Senior AI Engineer, Production LLM & Agent Systems

JPMorganChase; Jersey City (NJ); On-site; USD 171,000 - 260,000; Full time

Job summary

JPMorganChase is building production AI agents on the NEO platform within the Corporate & Investment Bank tech organization. You will design, productionize, and operate LLM-powered agents across CIB and Payments, turning real use cases into shipped systems.

The role focuses on agent workflows, retrieval and memory design, rigorous evaluation, guardrails, and secure deployment on public cloud (AWS/Azure), supporting end-to-end delivery from prototype to production.

Qualifications

• MS in Computer Science, Statistics, Mathematics, Machine Learning, or related field (or equivalent).
• Minimum 7 years of development experience, with at least 4 years on AI/ML solutions.
• Hands-on production experience building LLM-powered or agentic applications, with tracing, evaluations, and guardrails.
• Strong programming skills in Python and knowledge of data structures, algorithms, ML, data mining, IR, and statistics.
• Practical RAG experience, including retrieval quality, embeddings, and vector stores.
• Expert knowledge of AWS, Azure, or Kubernetes.

Responsibilities

• Design and ship production agents on NEO across the federated portfolio, from prototype to production.
• Build retrieval that performs in production via chunking, ranking, and grounding for accurate, auditable answers.
• Design agent memory with episodic and semantic memory as memory nodes, with recall and decay policies.
• Own context management with entitlement-, lineage-, and tenant-aware context for restricted information access.
• Compose multi-agent workflows using A2A, integrating tools and data through MCP servers (Bitbucket, Confluence, Databricks, Kubernetes, Snowflake, Splunk).
• Build and run evaluations, including task-level and end-to-end agent evaluations, regression suites, and quality/safety gating.

Skills

Python

AWS

Azure

Kubernetes

SQL

NoSQL

OpenSearch

Redis

Embeddings

LLM-as-judge

Education

MS in Computer Science or related field

Tools

Databricks

MCP

Bitbucket

Confluence

Snowflake

Postgres

OpenSearch

Redis

Job description

JPMorganChase is building production AI agents on the NEO platform within the Corporate & Investment Bank tech organization. You will design, productionize, and operate LLM-powered agents across CIB and Payments, turning real use cases into shipped systems.

The role focuses on agent workflows, retrieval and memory design, rigorous evaluation, guardrails, and secure deployment on public cloud (AWS/Azure), supporting end-to-end delivery from prototype to production.