Senior AI/ML Lead Engineer: Production Agents & Graph RAG

JP Morgan Chase; Jersey City (NJ); On-site; USD 180,000 - 240,000; Full time

Job summary

JP Morgan Chase is seeking a Senior Lead Software Engineer to guide agile teams in building secure, scalable AI/ML driven technology products within the Commercial and Investment Bank Digital & Platform Services, Data Analytics. You will design production agents, implement Graph RAG strategies, and ensure robust memory models across a federated portfolio.

Responsibilities include shaping the SDLC, partnering with product and business units, and deploying on AWS/Azure with strong security and

Qualifications

• 5+ years in software engineering with 4+ years in AI/ML solutions.
• Hands-on system design, development, testing, and operational stability.
• Advanced Python with data structures, algorithms, ML, data mining, info retrieval, stats.
• Experience building production LLM-powered/agentic apps, incl. tracing & guardrails.
• Proficient with Kubernetes and AWS/EKS, micro-VMs, and secure, scalable stacks.
• RAG experience— embeddings, vector stores; AWS/Azure/Kubernetes knowledge.
• Excellent communication with senior tech/business partners.
• SDLC proficiency and strong Agile CI/CD, resiliency, and security.
• Industry knowledge of financial services IT systems.

Responsibilities

• Provide technical guidance to business teams, contractors, and vendors.
• Design and deploy production agents across the federated portfolio.
• Build production-ready retrieval with graph RAG, vector search, chunking, ranking, grounding.
• Design episodic and semantic memory for agents; manage memory nodes.
• Manage organizational context with entitlements, lineage, and tenant awareness.
• Integrate tools and data via MCP servers (Bitbucket, Confluence, Databricks, Kubernetes, Snowflake, Splunk).
• Develop evals, ML safety gates, and end-to-end agent testing.
• Deploy solutions on AWS/Azure with SDLC, security, and observability.
• Partner with product and business stakeholders to ship supported agents.
• Serve as SME and advocate for firmwide SDLC frameworks and practices.

Skills

Python

LLM-powered applications

Kubernetes

AWS

Azure

Graph RAG

Information retrieval

Data mining

Go

Rust

PostgreSQL

OpenSearch

Education

MS in Computer Science / Statistics / Mathematics / ML or related

Tools

Bitbucket

Confluence

Databricks

Kubernetes

Snowflake

Splunk

Job description

JP Morgan Chase is seeking a Senior Lead Software Engineer to guide agile teams in building secure, scalable AI/ML driven technology products within the Commercial and Investment Bank Digital & Platform Services, Data Analytics. You will design production agents, implement Graph RAG strategies, and ensure robust memory models across a federated portfolio.

Responsibilities include shaping the SDLC, partnering with product and business units, and deploying on AWS/Azure with strong security and