Training / AI Infrastructure

Genesis

San Carlos (CA)

Vor Ort

USD 180.000 - 240.000

Vollzeit

14 Tage+

Erhalte eine Antwort von diesem Arbeitgeber

Dein Lebenslauf und dein Anschreiben, genau auf das zugeschnitten, was gesucht wird.

Schaffe es an den ATS-Filtern vorbei

Zusammenfassung

Genesis is seeking an experienced engineer to optimize large-scale ML training systems. You will profile bottlenecks from data pipelines to GPU kernels, design scalable distributed training with PyTorch, and implement low-level CUDA/CuDNN/Triton optimizations that integrate into high-level training workflows.

Your work will ensure robust, high-utilization performance across multi-node GPU clusters, with emphasis on hardware-aware software optimization and tooling for rapid diagnosis of

Qualifikationen

  • 8+ years in distributed ML infrastructure, HPC, or similar

Aufgaben

  • Profile and reduce wall-clock time to convergence across the training stack.
  • Design and optimize distributed PyTorch training on multi-node GPU clusters.
  • Implement low-level CUDA/cuDNN/Triton kernels and integrate with high-level frameworks.
  • Optimize CPU/GPU balance, memory, throughput, and networking for hardware efficiency.
  • Develop monitoring and debugging tools for large-scale runs to diagnose regressions.

Kenntnisse

Python programming
Distributed systems
Performance optimization
System-level tuning

Tools

PyTorch
CUDA
cuDNN
Triton

Jobbeschreibung

What You’ll Do
  • Drive down wall-clock time to convergence by profiling and eliminating bottlenecks across the foundation model training stack stack, from data pipelines to GPU kernels

  • Design, build, and optimize distributed training systems (PyTorch) for multi-node GPU clusters, ensuring scalability, robustness, and high utilization

  • Implement efficient low-level code (CUDA, cuDNN, Triton, custom kernels) and integrate it seamlessly into high-level training frameworks

  • Optimize workloads for hardware efficiency: CPU/GPU compute balance, memory management, data throughput, and networking

  • Develop monitoring and debugging tools for large-scale runs, enabling rapid diagnosis of performance regressions and failures

What You’ll Bring
  • Deep experience in distributed systems, ML infrastructure, or high-performance computing (8+ years)

  • Production-grade expertise in Python

  • Low-level performance mastery: CUDA/cuDNN/Triton, CPU–GPU interactions, data movement, and kernel optimization

  • Scaling at the frontier: experience with PyTorch and training jobs using data, context, pipeline, and model parallelism

  • System-level mindset with a track record of tuning hardware–software interactions for maximum utilization

Hol dir deinen kostenlosen, vertraulichen Lebenslauf-Check.

oder ziehe deine Datei hierhin.

Similar jobs

Ähnliche Jobs, die dir auch gefallen könnten

Training / AI Infrastructure
Training / AI Infrastructure

Genesis AI • San Carlos (CA)

Vor Ort
USD 180.000 - 240.000
Training / AI Infrastructure
Training / AI Infrastructure

Genesis AI • USA

Hybrid
USD 190.000 - 240.000
Training / AI Infrastructure
Training / AI Infrastructure

Genesis AI • San Francisco (CA)

Vor Ort
USD 180.000 - 260.000
Research Scientist / Engineer – Training Infrastructure
Research Scientist / Engineer – Training Infrastructure

lumaai • USA

Remote
USD 180.000 - 240.000
Member of Technical Staff, ML Systems ML Systems
Member of Technical Staff, ML Systems ML Systems

TensorScale • San Francisco (CA)

Vor Ort
USD 180.000 - 260.000
Inference
Inference

Genesis AI • USA

Vor Ort
USD 180.000 - 240.000
ML Systems Engineer — Performance & Scale
ML Systems Engineer — Performance & Scale

Veeda Innovation • California

Hybrid
USD 150.000 - 230.000
Machine Learning Infrastructure Engineer, Kernel Optimization
Machine Learning Infrastructure Engineer, Kernel Optimization

Efference • San Francisco (CA)

Vor Ort
USD 180.000 - 240.000
Member of Technical Staff - ML Performance
Member of Technical Staff - ML Performance

Veeda AI • California

Vor Ort
USD 180.000 - 240.000
Member of Technical Staff - ML Performance
Member of Technical Staff - ML Performance

Veeda AI • Seattle (WA)

Vor Ort
USD 180.000 - 260.000