Member of Technical Staff, ML Systems ML Systems

TensorScale

San Francisco (CA)

Vor Ort

USD 180.000 - 260.000

Vollzeit

vor 3 Stunden
Sei unter den ersten Bewerbenden

Eine vollständige Bewerbung in einer Minute

Maßgeschneiderter Lebenslauf und Anschreiben – versandbereit.

Schaffe es an den ATS-Filtern vorbei

Zusammenfassung

TensorScale in the San Francisco Bay Area seeks a GPU systems engineer to optimize speed and efficiency from kernels to distributed inference engines. You will improve training and inference for image, video, and world-model workloads with hands-on CUDA and Triton work.

You will profile bottlenecks with Nsight, design scalable multi-GPU deployments, and build benchmarks to ensure gains persist in production. Strong PyTorch knowledge and onsite work in the Bay Area are required.

Qualifikationen

  • 1+ years in deep learning inference/training systems or HPC.
  • Proficiency in CUDA and GPU profiling (Nsight).
  • Strong systems instincts across GPU architecture and kernels.
  • Experience with distributed multi-GPU debugging/optimization.
  • Familiarity with PyTorch and performance-critical model execution.
  • Comfort working onsite in the Bay Area.

Aufgaben

  • Optimize system and GPU performance of training and inference for image, video, and world-model workloads.
  • Profile and remove bottlenecks at kernel, memory, system, and cluster levels (Nsight and related tooling).
  • Implement low-level optimizations in CUDA / Triton.
  • Design and improve distributed inference / training engines for diffusion models.
  • Own communication performance across GPUs and nodes: NCCL, RDMA / InfiniBand / RoCE, and disaggregated serving.
  • Build benchmarking and regression harnesses so performance gains stick in production.
  • Hardware-aware kernel, runtime, and model co-design.

Kenntnisse

CUDA kernel optimization
Distributed systems
GPU profiling
PyTorch
Nsight tools

Tools

CUDA
Triton
Nsight
NCCL
InfiniBand/RoCE

Jobbeschreibung

Own speed and efficiency across the stack—from low-level GPU kernels to distributed inference engines and multi-node training/serving systems.

What you’ll do
  • Optimize system and GPU performance of training and inference for image, video, and world-model workloads
  • Profile and remove bottlenecks at kernel, memory, system, and cluster levels (Nsight and related tooling)
  • Implement low-level optimizations in CUDA / Triton
  • Design and improve distributed inference / training engines for diffusion models
  • Own communication performance across GPUs and nodes: NCCL, RDMA / InfiniBand / RoCE, and disaggregated serving
  • Build benchmarking and regression harnesses so performance gains stick in production
  • Hardware-aware kernel, runtime, and model co-design
  • 1+ years in deep learning inference/training systems, distributed systems, or high-performance computing
  • Proficiency in CUDA, with hands-on GPU profiling (e.g. Nsight)
  • Strong systems instincts across GPU architecture, parallel programming, and compute kernels
  • Experience with distributed multi-GPU debugging and optimization
  • Familiarity with PyTorch and performance-critical model execution
  • Comfort working onsite with the team in the Bay Area
Preferred qualifications
  • Experience optimizing diffusion, video, VLM, or other multimodal models for training and inference
  • Deep familiarity with modern inference / runtime stacks (vLLM, SGLang, TensorRT-LLM, or equivalent)
  • Experience with NCCL, RDMA, InfiniBand/RoCE, or disaggregated serving
  • Knowledge of ML compilers and graphs (Triton, torch.compile, XLA, TensorRT)
  • Contributions to open-source ML systems
  • Background co-designing models and runtimes for emerging accelerators
Hol dir deinen kostenlosen, vertraulichen Lebenslauf-Check.

oder ziehe deine Datei hierhin.

Similar jobs

Ähnliche Jobs, die dir auch gefallen könnten

Member of Technical Staff, ML Systems
Member of Technical Staff, ML Systems

true-talent-solutions-partners • Menlo Park (CA)

Vor Ort
USD 180.000 - 230.000
ML Systems Engineer — Performance & Scale
ML Systems Engineer — Performance & Scale

Veeda Innovation • California

Hybrid
USD 150.000 - 230.000
Member of Technical Staff - ML Performance
Member of Technical Staff - ML Performance

Veeda Innovation • California

Vor Ort
USD 150.000 - 230.000
Member of Technical Staff, MLSys
Member of Technical Staff, MLSys

Bake AI Inc. • San Mateo (CA)

Vor Ort
USD 180.000 - 240.000
Member of Technical Staff, ML Systems — Confidential AI Infrastructure Startup
Member of Technical Staff, ML Systems — Confidential AI Infrastructure Startup

Aionia Group • Menlo Park (CA)

Vor Ort
USD 150.000 - 210.000
Member of Technical Staff, GPU & Distributed Systems
Member of Technical Staff, GPU & Distributed Systems

Reactor • San Francisco (CA)

Vor Ort
USD 160.000 - 230.000
Machine Learning Infrastructure Engineer, Kernel Optimization
Machine Learning Infrastructure Engineer, Kernel Optimization

Efference • San Francisco (CA)

Vor Ort
USD 180.000 - 240.000
Member of Technical Staff - ML Performance
Member of Technical Staff - ML Performance

Veeda AI • California

Vor Ort
USD 180.000 - 240.000
Member of Technical Staff - ML Performance
Member of Technical Staff - ML Performance

Veeda AI • Seattle (WA)

Vor Ort
USD 180.000 - 260.000
Member of Technical Staff (AI Inference Engineer)
Member of Technical Staff (AI Inference Engineer)

FDE Times • San Francisco (CA)

Vor Ort
USD 140.000 - 240.000