Senior AI Agents Engineer — LLM Systems

Testing Site - JPMC; New York (NY); On-site; USD 160,000 - 240,000; Full time

Job summary

Testing Site - JPMC in New York is seeking an AI Agents Applied Research/Engineering Senior Associate to lead end-to-end lifecycle of LLM-based agents, shaping research directions and building production systems. You'll collaborate with Product, Engineering, Design, and Risk to deploy auditable, safe AI in a highly regulated domain, and publish at top venues.

This role emphasizes performance, latency, privacy, and governance to transform financial tasks into simple conversations for millions of

Qualifications

• BS with 3+ years or MS with 2+ years building and deploying AI systems in production.
• Applied GenAI experience with LLMs including fine-tuning, prompt engineering, and RAG.
• Experience scaling LLM systems with caching, batching, governance, and evaluation.
• Strong foundation in ML, deep learning, statistical modeling, and experimental design.
• Experience in Information Retrieval (indexing, ranking, retrieval) and/or recommendation systems.
• Proficiency in Python and ML frameworks (PyTorch/TensorFlow, Hugging Face, scikit-learn)
• Demonstrated ability to set a technical research agenda and drive it from concept through production deployment.

Responsibilities

• Perform research and deployment of agentic AI systems with multi-step workflows, tool calling, and multi-agent orchestration.
• Fine-tune and optimize LLMs using parameter-efficient fine-tuning (PEFT), distillation, and quantization to meet production constraints such as latency, memory, and cost.
• Apply reinforcement learning and preference optimization to improve personalization and dialogue policies.
• Scale LLM systems through caching, batching, prompt governance, and evaluation frameworks.
• Implement privacy, safety, and security controls including PCI compliance, jailbreak resistance, and auditability.
• Design rigorous experiments with strong baselines and meaningful metrics.
• Define and track success metrics for agent performance, including task completion rate, accuracy, latency, and customer satisfaction.

Skills

GenAI experience

LLMs (large language models)

Fine-tuning

Prompt engineering

RAG (retrieval-augmented generation)

ML fundamentals

Experimental design

Python

PyTorch/TensorFlow

Hugging Face

Information Retrieval

Performance optimization

Education

Bachelor's degree in a related field

MS degree preferred

Tools

Python

PyTorch

TensorFlow

Hugging Face

scikit-learn

Job description

Testing Site - JPMC in New York is seeking an AI Agents Applied Research/Engineering Senior Associate to lead end-to-end lifecycle of LLM-based agents, shaping research directions and building production systems. You'll collaborate with Product, Engineering, Design, and Risk to deploy auditable, safe AI in a highly regulated domain, and publish at top venues.

This role emphasizes performance, latency, privacy, and governance to transform financial tasks into simple conversations for millions of