Senior AI Agent Engineer - Production LLMs on NEO

JPMorgan Chase & Co.; Jersey City (NJ); On-site; USD 150,000 - 190,000; Full time

Job summary

JPMorgan Chase & Co. is seeking a Senior AI Application Engineer to design, productionize, and operate LLM-powered agents on the NEO runtime platform.

You will deploy on AWS/Azure, ensure security, and scale agents across Corporate & Investment Bank, and Payments with a strong emphasis on MLOps and governance. The role requires hands-on development experience in AI/ML, Python, and performing guardrails, with the ability to partner with product and business teams to deliver production-ready AI

Qualifications

• MS in Computer Science, Statistics, Mathematics, Machine Learning, or related field (or equivalent experience).
• Minimum 7 years of development experience, with at least 4 years on AI/ML solutions.
• Hands-on experience building LLM-powered or agentic applications in production, including tracing, evaluations, and guardrails.
• Strong programming skills in Python, with knowledge of data structures, algorithms, ML, data mining, IR, and statistics.
• Practical RAG experience - retrieval quality, embeddings, and vector stores.
• Expert knowledge of at least one: AWS, Azure, Kubernetes.
• Knowledge of data management and data model design; real-time processing with SQL and NoSQL stores.
• Excellent communication skills with senior stakeholders.

Responsibilities

• Design and ship production agents on the NEO platform across the portfolio from prototype to production.
• Build retrieval that stays robust in production: chunking, ranking, grounding for accuracy and auditable results.
• Design agent memory with episodic and semantic memory, memory nodes, recall and decay policies.
• Own context management: entitlement, lineage, and tenant-aware data for agent reasoning scopes.
• Compose multi-agent workflows using A2A and integrate tools via MCP servers (Bitbucket, Confluence, Databricks, Kubernetes, Snowflake, Splunk).
• Run evals, regression suites, and LLM-as-judge for quality and safety gates before release.
• Deploy and operate solutions on AWS and Azure with strong SDLC, security, resiliency, and observability practices.
• Partner with product and business to turn use cases into shipped, supported agents.

Skills

Python

AI/ML development

LLM-powered apps

RAG retrieval

Data structures & algorithms

Communication

Education

MS in Computer Science or related field

Tools

AWS

Azure

Kubernetes

Databricks

Postgres

OpenSearch

Redis

Bitbucket

Confluence

Snowflake

Job description

JPMorgan Chase & Co. is seeking a Senior AI Application Engineer to design, productionize, and operate LLM-powered agents on the NEO runtime platform.

You will deploy on AWS/Azure, ensure security, and scale agents across Corporate & Investment Bank, and Payments with a strong emphasis on MLOps and governance. The role requires hands-on development experience in AI/ML, Python, and performing guardrails, with the ability to partner with product and business teams to deliver production-ready AI