VP, Large-Scale ML Training & Performance Engineer

Testing Site - JPMC

New York (NY)

On-site

USD 180,000 - 240,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

JPMorgan Chase’s Global Technology Applied Research (GTAR) center is seeking a senior engineer to design, optimize, and scale large‑model pretraining workloads across hyperscale accelerator clusters. This hands‑on role focuses on distributed systems, kernel optimization, and end‑to‑end training performance, with impact on throughput and cost.

The candidate will design parallelism layouts, memory strategies, and inter‑node data movement, while partnering with hardware and software teams to

Qualifications

  • Master’s degree with 3+ years of industry experience or PhD with 1+ years.
  • Experience at AI labs, HPC centers, chip vendors, or hyperscale ML infra teams.
  • Strong experience across multinode accelerator clusters and distributed training.

Responsibilities

  • Design distributed training strategies for large-scale models.
  • Manage end-to-end training performance from data pipelines to checkpointing.
  • Profile and identify performance bottlenecks using standard tools.
  • Develop or optimize high-performance kernels (CUDA, Triton).
  • Design distributed communication strategies to maximize compute-data overlap.
  • Configure memory-efficient training (sharding, caching, checkpointing).
  • Evaluate training on multiple accelerator platforms (GPUs and others).

Skills

Distributed training
Python
C++
GPU kernels
Profiling tools
NCCL/collectives
PyTorch/JAX
Memory/optimizer sharding
Performance modeling

Education

Master's degree + 3+ years
PhD + 1+ years

Tools

Nsight
PyTorch profiler

Job description

JPMorgan Chase’s Global Technology Applied Research (GTAR) center is seeking a senior engineer to design, optimize, and scale large‑model pretraining workloads across hyperscale accelerator clusters. This hands‑on role focuses on distributed systems, kernel optimization, and end‑to‑end training performance, with impact on throughput and cost.

The candidate will design parallelism layouts, memory strategies, and inter‑node data movement, while partnering with hardware and software teams to

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Distributed Training & Performance Engineer - Vice President
Distributed Training & Performance Engineer - Vice President

Testing Site - JPMC • New York (NY)

On-site
USD 180,000 - 240,000
Senior ML Platform Engineer: GPU Training & Cloud Infra
Senior ML Platform Engineer: GPU Training & Cloud Infra

JPMorgan Chase & Co. • Palo Alto (CA)

On-site
USD 180,000 - 240,000
Senior ML Platform Engineer - GPU Training on Cloud
Senior ML Platform Engineer - GPU Training on Cloud

JP Morgan Chase • New York (NY)

On-site
USD 180,000 - 240,000
Health insurance
Retirement plan
Tuition reimbursement
+1
Senior ML Platform Engineer: GPU Training & Cloud
Senior ML Platform Engineer: GPU Training & Cloud

JP Morgan Chase • Palo Alto (CA)

On-site
USD 160,000 - 210,000
Senior ML Platform Engineer - GPU Training Systems
Senior ML Platform Engineer - GPU Training Systems

JPMorgan Chase & Co. • Palo Alto (CA)

On-site
USD 150,000 - 210,000
VP, AI Algorithms Research & Large-Scale ML Innovation
VP, AI Algorithms Research & Large-Scale ML Innovation

JP Morgan Chase • New York (NY)

On-site
USD 180,000 - 260,000
Lead ML Platform Engineer — GPU Training on Cloud
Lead ML Platform Engineer — GPU Training on Cloud

JPMorgan Chase & Co. • Palo Alto (CA)

On-site
USD 180,000 - 270,000
Senior ML Platform Engineer - GPU Training & Cloud Infra
Senior ML Platform Engineer - GPU Training & Cloud Infra

JP Morgan Chase • Jersey City (NJ)

On-site
USD 140,000 - 210,000
Senior ML Platform Engineer: GPU Training & Cloud Pipelines
Senior ML Platform Engineer: GPU Training & Cloud Pipelines

JP Morgan Chase • Seattle (WA)

On-site
USD 138,000 - 185,000
Senior ML Platform Engineer - GPU Training & Cloud
Senior ML Platform Engineer - GPU Training & Cloud

Aumni • Palo Alto (CA)

On-site
USD 180,000 - 260,000
Competitive total rewards
Health care coverage
Equity eligibility