Lead AI/ML Engineer — Production LLM Agents on NEO

JPMorganChase; Jersey City (NJ); On-site; USD 140,000 - 180,000; Full time

Benefits offered by this job

Health insurance

401(k)

Job summary

JPMorganChase in Jersey City seeks a Lead Software Engineer to join the Commercial & Investment Bank Technology group. You will design, productionize, and operate AI-powered agents on NEO, collaborating with product and engineering teams in a fast-paced environment.

You will own end-to-end delivery of LLM-driven solutions, build Graph RAG retrieval, and ensure security, observability, and scalability across AWS/Azure.

Qualifications

• 5+ years applied experience with AI/ML solutions, plus 4+ years in production settings.
• Hands-on experience delivering system design, application development, testing, and operations.
• Strong programming skills in Python with data structures, algorithms, ML, data mining, IR, and statistics.
• Experience building LLM-powered or agentic applications in production with tracing, evaluations, and guardrails.
• Deep proficiency with Kubernetes and Amazon EKS, micro-VMs, and defense-in-depth across the stack.

Responsibilities

• Design and ship production agents on NEO across the federated portfolio from prototype to production.
• Build production-grade retrieval with graph RAG, vector search, chunking, ranking and grounding strategies.
• Design agent memory including episodic and semantic memory; manage recall and decay policies.
• Own organizational context management with entitlement, lineage, and tenant-aware contexts.
• Collaborate with product, business, and engineering teams to turn use cases into shipped agents.
• Lead evaluations with external vendors and internal teams to validate architecture and credentials.

Skills

Python

Kubernetes

AWS

Azure

AI/ML

CI/CD

Security

Communication

Go/Rust

Education

MS in Computer Science or related field

Tools

Databricks

Snowflake

OpenSearch

Redis

Bitbucket

Confluence

Job description

JPMorganChase in Jersey City seeks a Lead Software Engineer to join the Commercial & Investment Bank Technology group. You will design, productionize, and operate AI-powered agents on NEO, collaborating with product and engineering teams in a fast-paced environment.

You will own end-to-end delivery of LLM-driven solutions, build Graph RAG retrieval, and ensure security, observability, and scalability across AWS/Azure.