Senior Associate- Applied AI/ML

JP Morgan Chase

Jersey City (NJ)

On-site

USD 180,000 - 240,000

Full time

4 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

JP Morgan Chase in Jersey City is seeking a senior engineer to craft agentic AI systems across NLP, time series, and RL, with memory and tool orchestration. You will design robust architectures, enforce safety and traceability, and build knowledge-grounded reasoning layers.

Responsibilities include spec-driven development, auto-evaluation loops, and multi-agent orchestration for SRE/observability, integrating Dynatrace, Splunk, and CloudWatch. Strong Python and MCP familiarity preferred.

Qualifications

  • Studies in CS/EE/Math or equivalent experience in industry/research.
  • Expertise in building agentic AI systems with memory, orchestration, and prompts.
  • Hands-on ML/DL with PyTorch/TensorFlow and Python data stack.
  • Ability to design experiments with metrics tied to business outcomes.
  • Experience with scalable data/model workflows and strong software practices.

Responsibilities

  • Develop advanced agentic AI solutions across NLP, speech analytics, time series, RL, and recommendations.
  • Design robust agent architectures integrating LLM reasoning with tools, data, and APIs.
  • Engineer reliable agent workflows emphasizing correctness, traceability, and control.
  • Build knowledge-centric reasoning layers with knowledge graphs and hybrid retrieval.
  • Drive spec-driven development with schemas, validators, and interfaces.
  • Advance agent quality via autonomous evaluation loops and human-in-the-loop.
  • Design multi-agent orchestration pipelines for SRE/observability with Dynatrace, Splunk, and CloudWatch.
  • Author formal agent specs: phase protocols, constraints, and checkpoint schemas.
  • Implement causal reasoning and evidence-based RCA with confidence scoring.
  • Create A/B parity frameworks and regression harnesses for releases.

Skills

Agentic AI systems
Loop engineering
Python scripting
Observability tooling
Tool orchestration
Prompt optimization

Tools

Dynatrace
Splunk
Datadog
New Relic
AWS CloudWatch

Job description

Job Responsibilities
  • Develop advanced agentic AI solutions across NLP, speech analytics, time series, reinforcement learning, and recommendation systems.
  • Design robust agent architectures combining LLM reasoning with tools, structured data, and APIs-spanning state, memory, and context management, plus loop engineering (plan/act/observe, verification, termination, and fallback/escalation).
  • Engineer reliable agent-driven workflows emphasizing correctness, traceability, and control-aware behavior (guardrails, approvals, auditable decision paths).
  • Build knowledge-centric reasoning layers, including knowledge graphs and hybrid retrieval (RAG + graph + structured sources) to improve grounding and accuracy.
  • Drive specification-driven development: author specs and contracts (schemas, validators, tool/skill interfaces) and build evaluation/regression harnesses.
  • Advance agent quality via recursive self-improvement through automated evaluation and critique loops, red-team feedback, skill/prompt instruction optimization, and outcome-driven dataset curation (human-in-the-loop as needed).
  • Design and implement multi-agent orchestration pipelines for SRE/observability use cases - integrating Dynatrace APM (problem APIs, golden signals, entity resolution), Splunk/SPL (Atlas CloudWatch and OnPrem query patterns), infrastructure metadata , code search, and JIRA ticket automation.
  • Author agent specs as formal contracts: define phase-by-phase protocols, STRICT CONSTRAINTS, backflow/escalation signals, auth-error handling, and per-phase checkpoint schemas.
  • Implement causal reasoning frameworks for evidence-based RCA and confidence scoring.
  • Build A/B parity evaluation frameworks and regression harnesses to measure agent behavior changes across releases; define merge-gate criteria and scoreboard metrics.
  • Develop MCP (Model Context Protocol) server integrations and plugin architectures for AI coding assistants (Claude Code).
  • Implement per-application customization knowledge banks and agent memory systems that persist context across investigation phases.
  • Coach and mentor AIML team members, setting a high bar for engineering rigor and research depth.
Required Qualifications, Capabilities, and Skills
  • Studies in a quantitative discipline ( CS/EE/Math/OR/Optimization/Data Science) or equivalent industry/research experience
  • Demonstrated expertise building agentic AI systems, including several of: memory/state/context management, tool orchestration and workflow reliability patterns, loop engineering, spec-driven development, and prompt/skill instruction optimization.
  • Strong hands‑on experience with ML/DL methods and toolkits (e.g., PyTorch/TensorFlow plus core Python data/ML stack).
  • Ability to design experiments and evaluation frameworks with metrics aligned to business outcomes (quality, reliability, latency, cost, safety).
  • Experience with scalable data and model workflows (training and/or inference) and strong software engineering practices.
  • Strong communication skills to explain technical concepts to both technical and business audiences.
  • Hands‑on experience with at least one observability/APM platform (Dynatrace, Splunk, Datadog, New Relic, or equivalent) - including writing queries, interpreting golden signals, and using APIs for automated incident triage.
  • Proficiency in Python for pipeline scripting, automation, and agent tooling; comfort with JSON schema design and structured output validation.
  • Familiarity with AWS services relevant to observability and agentic workloads (ECS, EKS, Lambda, CloudWatch, ALB, Step Functions)
  • Familiarity with MCP (Model Context Protocol) server development or plugin authoring for AI coding assistants (Claude Code, GitHub Copilot, Cursor, or equivalent).
Preferred Qualifications, Capabilities, and Skills
  • Knowledge in search/ranking, reinforcement learning, or meta-learning (especially for agent routing, policies, and self‑improvement).
  • Experience with knowledge graphs, entity resolution, and ontology design.
  • Experience with A/B experimentation and metric‑driven product development; CI pipelines and unit/integration testing.
  • Hands‑on experience with Splunk SPL - writing complex search queries, index resolution, field extraction, and alert patterns for production observability.
  • Experience with Dynatrace APIs - entity queries, problem feeds, golden signal retrieval, and synthetic monitor management.
  • Experience with SRE practices: incident response workflows, root cause analysis methodology, SLOs/SLIs, on‑call operations, or production readiness reviews
  • Experience with GraphRAG, multi‑hop retrieval, or knowledge‑graph‑augmented agent reasoning.
  • Forward Deployed Engineering or Spec‑Driven Development experience - translating operational workflows into formal agent specs with schemas, validators, and compliance audit trails.
  • Experience building evaluation harnesses for long‑horizon agentic tasks: golden-dataset construction, LLM‑as‑judge scoring, regression detection, and parity testing across agent version
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior AI Agent Engineer
Senior AI Agent Engineer

EPAM Systems • United States

On-site
USD 150,000 - 210,000
Senior Full Stack Developer, Agentic Engineering
Senior Full Stack Developer, Agentic Engineering

FullBloom • United States

Remote
USD 140,000 - 180,000
Lead AI Agent Engineer
Lead AI Agent Engineer

EPAM Systems • United States

On-site
USD 180,000 - 240,000
Applied AI Engineer
Applied AI Engineer

Level AI • Austin (TX)

On-site
USD 180,000 - 260,000
Senior Product Manager
Senior Product Manager

EPAM Systems • United States

Remote
USD 170,000 - 220,000
Applied ML Engineer, Agents & Automation
Applied ML Engineer, Agents & Automation

Bask Health • New York (NY)

On-site
USD 120,000 - 180,000
Staff Engineer / AI Builder - Mountain View
Staff Engineer / AI Builder - Mountain View

robotsandpencils • Mountain View (CA)

On-site
USD 180,000 - 260,000
Applied AI Engineer
Applied AI Engineer

Level • Austin (TX)

On-site
USD 150,000 - 210,000
Senior Modernization Engineer (FDE)
Senior Modernization Engineer (FDE)

Unknown • London (OH)

Hybrid
USD 140,000 - 190,000
Agentic AI Developer
Agentic AI Developer

Xpetize • United States

Remote
USD 120,000 - 180,000