Staff Engineer, AI Inference & Performance

Reflection

United States

Remote

USD 150.000 - 230.000

Vollzeit

vor 44 Stunden
Sei unter den ersten Bewerbenden

Eine vollständige Bewerbung in einer Minute

Maßgeschneiderter Lebenslauf und Anschreiben – versandbereit.

Schaffe es an den ATS-Filtern vorbei

Benefits dieser Stelle

Top-tier compensation
Stock options
Health & wellness
Meals
Life & family
Vacation days
Sponsorship support
Team building

Zusammenfassung

Reflection is seeking an engineering leader to own inference performance for pre-training evaluations. You will bridge our training framework to the inference stack, optimize GPU/CPU, memory, and scheduling, and ensure correct, scalable delivery of models.

You will work with researchers and engineers, turning research into robust systems that scale with new models, hardware, and workloads, while shaping the future of open AI tooling.

Qualifikationen

  • Experience in large-scale distributed systems.
  • Experience with inference workloads and pre-training/post-training workflows.
  • Ability to quantify compute limits and memory bandwidth.

Aufgaben

  • Own inference performance and correctness for pre-training evaluations.
  • Bridge training to inference frameworks and optimize GPU/CPU usage.
  • Profile CPU/GPU, memory, and scheduling to improve throughput and cost.
  • Improve autoscaling and fleet efficiency based on system signals.

Kenntnisse

Distributed systems
Inference infrastructure
GPU profiling
Performance optimization

Tools

PyTorch
CUDA

Jobbeschreibung

Reflection is seeking an engineering leader to own inference performance for pre-training evaluations. You will bridge our training framework to the inference stack, optimize GPU/CPU, memory, and scheduling, and ensure correct, scalable delivery of models.

You will work with researchers and engineers, turning research into robust systems that scale with new models, hardware, and workloads, while shaping the future of open AI tooling.

Hol dir deinen kostenlosen, vertraulichen Lebenslauf-Check.

oder ziehe deine Datei hierhin.

Similar jobs

Ähnliche Jobs, die dir auch gefallen könnten

Performance Engineer, Inference Systems
Performance Engineer, Inference Systems

Anthropic Limited • San Francisco (CA)

Hybrid
USD 350.000 - 850.000
Performance Engineer, Inference Systems
Performance Engineer, Inference Systems

Anthropic Limited • Seattle (WA)

Hybrid
USD 350.000 - 850.000
Senior AI Inference Performance Engineer
Senior AI Inference Performance Engineer

NVIDIA Corporation • Santa Clara (CA)

Vor Ort
USD 184.000 - 357.000
Lead GPU Inference Performance Engineer
Lead GPU Inference Performance Engineer

present of AI • USA

Remote
USD 140.000 - 210.000
Engineering Manager, GPU Inference Performance
Engineering Manager, GPU Inference Performance

Baseten • New York (NY)

Vor Ort
USD 240.000 - 270.000
Competitive compensation
Meaningful equity
Medical, dental, and vision insurance
+3
Engineering Manager - AI Inference & Systems, Equity
Engineering Manager - AI Inference & Systems, Equity

Inferact • San Francisco (CA)

Vor Ort
USD 200.000 - 400.000
Health benefits
Dental benefits
Vision benefits
+1
Remote Principal Engineer, Inference Performance
Remote Principal Engineer, Inference Performance

Runware • Palo Alto (CA)

Remote
USD 260.000 - 380.000
Stock options
Remote-first culture
Generous PTO
Senior AI Inference Optimization Engineer
Senior AI Inference Optimization Engineer

DigitalOcean, Inc. • Seattle (WA)

Hybrid
USD 191.000 - 239.000
Staff Engineer, AI Inference Optimization
Staff Engineer, AI Inference Optimization

DigitalOcean, Inc. • Boston (MA)

Remote
USD 191.200 - 239.000
Equity compensation
Bonus potential
Conference reimbursement
+2
Principal Engineer, Model Performance — Remote Inference at Scale
Principal Engineer, Model Performance — Remote Inference at Scale

Runware • San Francisco (CA)

Remote
USD 180.000 - 280.000
Stock options
Remote-first culture
Flexible schedule
+1