Distributed Training & Performance Engineer - Vice President

Testing Site - JPMC

New York (NY)

On-site

USD 180,000 - 240,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

JPMorgan Chase’s Global Technology Applied Research (GTAR) center is seeking a senior engineer to design, optimize, and scale large‑model pretraining workloads across hyperscale accelerator clusters. This hands‑on role focuses on distributed systems, kernel optimization, and end‑to‑end training performance, with impact on throughput and cost.

The candidate will design parallelism layouts, memory strategies, and inter‑node data movement, while partnering with hardware and software teams to

Qualifications

  • Master’s degree with 3+ years of industry experience or PhD with 1+ years.
  • Experience at AI labs, HPC centers, chip vendors, or hyperscale ML infra teams.
  • Strong experience across multinode accelerator clusters and distributed training.

Responsibilities

  • Design distributed training strategies for large-scale models.
  • Manage end-to-end training performance from data pipelines to checkpointing.
  • Profile and identify performance bottlenecks using standard tools.
  • Develop or optimize high-performance kernels (CUDA, Triton).
  • Design distributed communication strategies to maximize compute-data overlap.
  • Configure memory-efficient training (sharding, caching, checkpointing).
  • Evaluate training on multiple accelerator platforms (GPUs and others).

Skills

Distributed training
Python
C++
GPU kernels
Profiling tools
NCCL/collectives
PyTorch/JAX
Memory/optimizer sharding
Performance modeling

Education

Master's degree + 3+ years
PhD + 1+ years

Tools

Nsight
PyTorch profiler

Job description

Are you looking for an exciting opportunity to join a dynamic and growing team in a fast paced and challenging area? This is a unique opportunity for you to work withGlobal Technology Applied Research(GTAR) center at JPMorganChase. The goal of GTAR is to design and conduct research across multiple frontier technologies, in order to enable novel discoveries and inventions, and to inform and develop next‑generation solutions for the firm’s clients and businesses.

As a senior‑level engineer within The Global Technology Applied Research (GTAR), you will design, optimize, and scale large‑model pretraining workloads across hyperscale accelerator clusters. This role sits at the intersection of distributed systems, kernel‑level performance engineering, and large‑scale model training. The ideal candidate can take a fixed hardware budget (accelerator type, node topology, interconnect, and cluster size) and design efficient, stable, and scalable training strategy, spanning parallelism layout, memory strategy, kernel optimization, and end‑to‑end system performance. This is a hands‑on role with direct impact on training throughput, efficiency, and cost at scale.

Job responsibilities
  • Design and optimize distributed training strategies for large‑scale models, including data, tensor, pipeline, context parallelism.
  • Manage end‑to‑end training performance: from data input pipelines through model execution, communication, and checkpointing.
  • Identify and eliminate performance bottlenecks using systematic profiling and performance modeling.
  • Develop or optimize high‑performance kernels using CUDA, Triton, or equivalent frameworks.
  • Design and optimize distributed communication strategies to maximize overlap between computation and inter‑node data movement.
  • Design memory‑efficient training configurations (caching, optimizer sharding, checkpoint strategies).
  • Evaluate and optimize training on multiple accelerator platforms, including GPUs and non‑GPU accelerators.
  • Contribute towards incorporating performance improvements back to internal pipelines.
Required qualifications, capabilities, and skills
  • Master’s degree with 3+ years of industry experiences, or Ph.D. degree with 1+ years of industry experience in computer science, physics, math, engineering or related fields.
  • Engineering experience at top AI labs, HPC centers, chip vendors, or hyperscale ML infra teams.
  • Strong experience designing and operating large‑scale distributed training jobs across multinode accelerator clusters.
  • Deep understanding of distributed parallelism strategies: data parallelism, tensor/model parallelism, pipeline parallelism, and memory/optimizer sharding.
  • Proven ability to profile and optimize training performance using industry standard tools such as Nsight, PyTorch profiler, or equivalent.
  • Hands‑on experience with GPU programming and kernel optimization.
  • Strong understanding of accelerator memory hierarchies, bandwidth limitations, and compute‑communication tradeoffs.
  • Experience with collective communication libraries and patterns (e.g., NCCL‑style collectives).
  • Proficiency in Python for ML systems development and C++ for performance‑critical components.
  • Experience with modern ML frameworks such as PyTorch or JAX in large‑scale training settings.
Preferred qualifications, capabilities, and skills
  • Experience optimizing training workloads on non‑GPU accelerators (e.g., TPU, or wafer‑scale architectures).
  • Familiarity with compiler‑driven ML systems (e.g., XLA, MLIR, Inductor) and graph‑level optimizations.
  • Experience designing custom fused kernels or novel execution strategies for attention or large matrix operations.
  • Strong understanding of scaling laws governing large‑model pretraining dynamics and stability considerations.
  • Contributions to open‑source ML systems, distributed training frameworks, or performance‑critical kernels.
  • Prior experience collaborating directly with hardware vendors or accelerator teams.
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

VP, Large-Scale ML Training & Performance Engineer
VP, Large-Scale ML Training & Performance Engineer

Testing Site - JPMC • New York (NY)

On-site
USD 180,000 - 240,000
Machine Learning Performance Engineer, Training
Machine Learning Performance Engineer, Training

towerresearchcapital • New York (NY)

On-site
USD 140,000 - 230,000
Advanced Chip Research Engineer - Vice President
Advanced Chip Research Engineer - Vice President

Testing Site - JPMC • New York (NY)

On-site
USD 150,000 - 190,000
Principal Software Engineer - High Performance Computing
Principal Software Engineer - High Performance Computing

JPMorgan Chase & Co. • Palo Alto (CA)

On-site
USD 210,000 - 260,000
AI Algorithms Research Scientist-Vice President
AI Algorithms Research Scientist-Vice President

JPMorgan Chase & Co. • New York (NY)

On-site
USD 180,000 - 240,000
Lead Software Engineer (AI Platform) - Vice President
Lead Software Engineer (AI Platform) - Vice President

JPMorgan Chase & Co. • New York (NY)

On-site
USD 180,000 - 250,000
Principal Software Engineer - High Performance Computing
Principal Software Engineer - High Performance Computing

Testing Site - JPMC • Seattle (WA)

On-site
USD 170,000 - 210,000
ML Systems Engineer — Performance & Scale
ML Systems Engineer — Performance & Scale

Veeda Innovation • California

Hybrid
USD 150,000 - 230,000
Member of Technical Staff, Model Training (infra & platform), Remote- Full TIme
Member of Technical Staff, Model Training (infra & platform), Remote- Full TIme

Xperteez Technology • United States

Remote
USD 180,000 - 260,000
Principal Software Engineer - High Performance Computing
Principal Software Engineer - High Performance Computing

JPMorgan Chase & Co. • Seattle (WA)

On-site
USD 140,000 - 180,000