Trading ML Systems Engineer - Distributed Training

Fintal Partners

New York (NY)

On-site

USD 185,000 - 230,000

Full time

14 days+

Get more replies from employers

Send a job-specific resume in minutes.

Job summary

Fintal Partners in New York is hiring engineers to build the distributed training and inference systems that take models from research into production. You’ll work side-by-side with researchers and traders on a trading floor-like environment, owning critical, IC-heavy infrastructure projects.

The role focuses on scaling training/inference at scale, optimizing for latency, and expanding a GPU footprint from thousands to tens of thousands, with top-tier compensation for engineers who can execute

Qualifications

  • Experience scaling training and inference infrastructure.
  • Deep PyTorch fluency and performance-focused mindset.
  • Distributed systems with multi-GPU/multi-node training and model serving.
  • Hands-on contributor, not a strategy seat.
  • Experience at top tech firm, trading firm, or a strong big-tech + startup combo.
  • 3+ years of relevant experience.

Responsibilities

  • Build and scale distributed training systems for large models.
  • Develop low-latency inference pipelines to production.
  • Work directly with researchers training the models and the traders/quants relying on them.
  • Operate on a rapidly growing GPU footprint (low thousands today, scaling into the tens of thousands).

Skills

PyTorch
Distributed systems
Performance engineering
Hands-on building
Trading background
3+ years experience

Job description

Fintal Partners in New York is hiring engineers to build the distributed training and inference systems that take models from research into production. You’ll work side-by-side with researchers and traders on a trading floor-like environment, owning critical, IC-heavy infrastructure projects.

The role focuses on scaling training/inference at scale, optimizing for latency, and expanding a GPU footprint from thousands to tens of thousands, with top-tier compensation for engineers who can execute

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

ML Systems Engineer: Scalable Training & Realtime Inference
ML Systems Engineer: Scalable Training & Realtime Inference

Jobzhr • New York (NY)

On-site
USD 180,000 - 280,000
Machine Learning Engineer (Training & Inference Systems)
Machine Learning Engineer (Training & Inference Systems)

Fintal Partners • New York (NY)

On-site
USD 185,000 - 230,000
Machine Learning Engineer (Training & Inference Systems)
Machine Learning Engineer (Training & Inference Systems)

Jobzhr • New York (NY)

On-site
USD 180,000 - 280,000
Staff ML Infra Engineer: Distributed Training & Inference
Staff ML Infra Engineer: Distributed Training & Inference

Jobtailor • Boston (MA)

On-site
USD 120,000 - 160,000
Distributed ML Training Engineer - Scale GPUs, Unlimited PTO
Distributed ML Training Engineer - Scale GPUs, Unlimited PTO

Thinking Machines Lab Inc. • San Francisco (CA), Northern (KY)

Hybrid
USD 350,000 - 475,000
Health benefits
Unlimited PTO
Parental leave
+1
Pre-Training ML Engineer—Foundation Models
Pre-Training ML Engineer—Foundation Models

Trading Interview • New York (NY)

On-site
USD 300,000 - 350,000
Medical insurance
Dental insurance
Vision insurance
+3
Senior ML Training Systems Engineer - Distributed GPU Infra
Senior ML Training Systems Engineer - Distributed GPU Infra

Baseten • San Francisco (CA)

On-site
USD 150,000 - 200,000
Competitive compensation, including equity
100% coverage of medical, dental, and vision insurance
Generous PTO policy
+2
Staff ML Systems Engineer — Distributed Training at Scale
Staff ML Systems Engineer — Distributed Training at Scale

RadixArk • Palo Alto (CA)

On-site
USD 120,000 - 160,000
Comprehensive benefits
Flexible work arrangements
Senior Distributed ML Training Engineer
Senior Distributed ML Training Engineer

Visa Hunt • San Francisco (CA), Northern (KY)

Hybrid
USD 220,000 - 310,000
Stock options
Health/dental/vision insurance
Meals provided in office
+1
ML Systems Engineer - Scalable Training & Inference
ML Systems Engineer - Scalable Training & Inference

Scale AI, Inc. • New York (NY)

On-site
USD 189,000 - 237,000
Equity
Benefits
Commuter stipend