Applied AI ML Director

JP Morgan Chase

Palo Alto (CA)

On-site

USD 350,000 - 650,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

JP Morgan Chase is seeking a Generative AI Executive Director to lead production-grade LLM systems (LLM Suite) and scale APIs and agentic workflows across enterprise AI. You will collaborate with ML Engineering, Product Management, and Cloud Engineering to deliver measurable business impact.

The role focuses on reliability, scalability, and ROI, with executive visibility and responsibility for production AI initiatives.

Qualifications

  • PhD or equivalent in a quantitative discipline.
  • Proven track record shipping production AI systems.
  • Expert in NLP/Computer Vision/multimodal LLM with solid ML theory.
  • Experience with distributed, scalable applications.

Responsibilities

  • Architect and deliver production LLM-based systems powering mission-critical LLM Suite products.
  • Own end-to-end delivery, performance, and continuous improvement of individual LLM Suite products.
  • Bridge advanced AI research with robust engineering to build production-ready solutions.
  • Drive results with an entrepreneurial mindset in a fast-paced, high-impact environment.

Skills

NLP
Computer Vision
Multimodal LLMs
Distributed ML Systems
Agentic workflows
Communication skills
Engineering leadership

Education

PhD in Computer Science / Mathematics / Statistics

Tools

Ray
Horovod
DeepSpeed
gRPC
REST
GraphQL
Protocol Buffers
Load balancing

Job description

At the heart of JP Morgan’s AI transformation is the Chief Analytics Office (CAO) — the team responsible for driving the firmwide adoption of artificial intelligence and advanced analytics. The CAO leads the strategy, governance, and delivery of AI/ML products across the company, ensuring that innovation is balanced with responsibility, security, and ethical best practices. By overseeing the build, adoption, and maintenance of AI solutions, the CAO empowers every line of business to leverage AI/ML at scale and unlock new value for clients and stakeholders.

As a Generative AI Executive Director within our CAO organization, you’ll be at the forefront of building and optimizing production-grade LLM systems (LLM Suite) that serve hundreds of thousands of professionals every day. You’ll architect and scale robust, reusable APIs and agentic workflows that process millions of documents and automate complex financial tasks. Collaboration is key: you’ll work closely with teams across ML Engineering, Product Management, and Cloud Engineering to deliver solutions that are measured, budgeted, and built for real business impact.

Your technical decisions will directly shape how JP Morgan leverages AI at enterprise scale. You’ll ensure LLM Suite is designed for reliability, scalability, and performance — enabling other teams to build on top of our infrastructure and accelerate innovation firmwide. This is not a research sandbox; it’s production infrastructure with executive visibility and measurable ROI.

If you’re ready to lead engineering teams, ship production AI, and make decisions that influence the future of financial technology, we invite you to join us and help define the next era of enterprise AI at JP Morgan.

Job Responsibilities
  • Architect and deliver production LLM based systems (text, image, speech, video) powering mission-critical LLM Suite products.
  • Own end-to-end delivery, performance, and continuous improvement of individual LLM Suite products.
  • Bridge advanced AI research with robust engineering to build innovative, production-ready solutions.
  • Drive results with an entrepreneurial mindset in a fast-paced, high-impact environment.
Required qualifications, capabilities, and skills
  • PhD or equivalent experience in Computer Science, Mathematics, Statistics, or a related quantitative discipline.
  • Extensive hands-on experience as an individual contributor in ML engineering, with a proven track record of shipping production AI systems.
  • Deep expertise in NLP, Computer Vision, and/or Multimodal LLM algorithms, with a strong foundation in statistics, optimization, and ML theory.
  • Practical experience implementing distributed, multi-threaded, and scalable applications using frameworks such as Ray, Horovod, DeepSpeed, etc.
  • Exceptional communication skills, able to convey complex technical concepts and build trust with stakeholders at all levels.
Preferred qualifications, capabilities, and skills
  • Advanced proficiency in designing and deploying production ML pipelines using DAG frameworks, including custom operator development and pipeline optimization.
  • Expertise in architecting and implementing high-throughput, low-latency microservices with gRPC, REST, and GraphQL, including protocol buffer schema design, streaming endpoints, and load balancing.
  • Hands-on experience with parameter-efficient fine-tuning (LoRA, QLoRA, IA3), model quantization (INT8, FP16, GPTQ), and quantization-aware training for LLMs at scale.
  • Deep knowledge of distributed training strategies (data/model/pipe parallelism), memory optimization, and inference acceleration for large-scale multimodal models.
  • Experience with advanced agentic workflow orchestration, including multi-agent coordination, stateful task management, and integration with enterprise event-driven architectures.

FEDERAL DEPOSIT INSURANCE ACT: This position is subject to Section 19 of the Federal Deposit Insurance Act. As such, an employment offer for this position is contingent on JPMorganChase’s review of criminal conviction history, including pretrial diversions or program entries.

#LI-RB3

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Applied AI ML Lead - AI Agents & Agentic Systems
Applied AI ML Lead - AI Agents & Agentic Systems

JPMorgan Chase & Co. • Palo Alto (CA)

On-site
USD 210,000 - 260,000
Principal Software Engineer - AI Foundations
Principal Software Engineer - AI Foundations

JP Morgan Chase • Jersey City (NJ)

On-site
USD 180,000 - 240,000
Director of Software Engineering
Director of Software Engineering

JP Morgan Chase • Palo Alto (CA)

On-site
USD 250,000 - 400,000
Applied AI ML Senior Associate -AI Agents & Agentic Systems
Applied AI ML Senior Associate -AI Agents & Agentic Systems

JPMorgan Chase & Co. • New York (NY)

On-site
USD 150,000 - 230,000
Applied AI ML Senior Associate -AI Agents & Agentic Systems
Applied AI ML Senior Associate -AI Agents & Agentic Systems

JP Morgan Chase • City of Rochester (NY)

On-site
USD 120,000 - 180,000
AI Engineer - Sr Lead Software Engineer
AI Engineer - Sr Lead Software Engineer

JPMorgan Chase & Co. • Wilmington (DE)

On-site
USD 120,000 - 180,000
Applied AI ML Director - AI Agents and Agentic Systems
Applied AI ML Director - AI Agents and Agentic Systems

JPMorgan Chase & Co. • Palo Alto (CA)

On-site
USD 250,000 - 420,000
AI Engineer - Sr Lead Software Engineer
AI Engineer - Sr Lead Software Engineer

JPMorgan Chase & Co. • Jersey City (NJ)

On-site
USD 150,000 - 190,000
Senior Lead Software Engineer - Java/Python/AWS/AI/LLM
Senior Lead Software Engineer - Java/Python/AWS/AI/LLM

JPMorgan Chase & Co. • Plano (TX)

On-site
USD 180,000 - 240,000
Lead Software Engineer - Java/Python/AWS/AI/LLM
Lead Software Engineer - Java/Python/AWS/AI/LLM

JPMorgan Chase & Co. • Plano (TX)

On-site
USD 150,000 - 190,000