Senior GPU Systems Engineer: Large-Scale Inference & RL

Reflection

Greater London

On-site

GBP 70,000 - 100,000

Full time

14 days+
Application generator

Don’t send a generic resume — generate a resume and cover letter tailored to this exact role.

Get past ATS filters

Benefits offered by this job

Top-tier compensation
Comprehensive medical, dental, and vision insurance
Fully paid parental leave
Paid time off and relocation support
Daily lunch and dinner provided

Job summary

Reflection is seeking an experienced professional to design and operate large-scale GPU infrastructure for model inference and reinforcement learning. The role involves developing systems for high-performance inference platforms, optimizing GPU utilization, and diagnosing performance bottlenecks. Ideal candidates will have hands-on experience with GPU systems, knowledge of modern inference frameworks, and skills in debugging complex performance issues across distributed systems. The company offers competitive compensation and comprehensive benefits.

Qualifications

  • Experience deploying and operating large-scale GPU systems for inference or model serving.
  • Several years of hands-on experience building and running production infrastructure.
  • Strong understanding of GPU performance characteristics and optimization techniques.
  • Experience working with modern inference frameworks such as SGLang, Megatron, or similar.
  • Familiarity with distributed reinforcement learning infrastructure.
  • Experience optimizing throughput for large-scale model execution workloads.
  • Experience working with GPU kernels or low-level performance optimization.
  • Familiarity with infrastructure used for synthetic data pipelines.
  • Experience debugging performance issues across GPU and networking.

Responsibilities

  • Design, build, and operate large-scale GPU infrastructure for high-throughput model inference.
  • Develop systems for synthetic data generation and reinforcement learning pipelines.
  • Build high-performance inference platforms across thousands of GPUs.
  • Optimize throughput and latency for large language model inference.
  • Support distributed RL workloads and large-scale model evaluation infrastructure.
  • Improve performance through kernel-level optimization and model parallelism.
  • Diagnose and resolve performance bottlenecks in distributed compute systems.

Skills

Operating large-scale GPU systems
Building production infrastructure
GPU performance optimization
Inference frameworks (SGLang, Megatron)
Distributed reinforcement learning
Throughput optimization
GPU kernels debugging
Synthetic data pipelines
Performance issue debugging

Job description

Reflection is seeking an experienced professional to design and operate large-scale GPU infrastructure for model inference and reinforcement learning. The role involves developing systems for high-performance inference platforms, optimizing GPU utilization, and diagnosing performance bottlenecks. Ideal candidates will have hands-on experience with GPU systems, knowledge of modern inference frameworks, and skills in debugging complex performance issues across distributed systems. The company offers competitive compensation and comprehensive benefits.
Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

Member of Technical Staff - Mid-Training Infra
Member of Technical Staff - Mid-Training Infra

Reflection • Greater London

On-site
GBP 70,000 - 100,000
Top-tier compensation
Comprehensive medical, dental, and vision insurance
Fully paid parental leave
+2
Staff AI Systems Engineer - Pre-Training Infra
Staff AI Systems Engineer - Pre-Training Infra

Reflection • Greater London

On-site
GBP 70,000 - 100,000
Senior ML Infra Architect for Large-Scale AI Simulations
Senior ML Infra Architect for Large-Scale AI Simulations

Hamilton Barnes Associates Limited • United Kingdom

Hybrid
GBP 90,000 - 130,000
Significant stock option packages
Remote-first working setup
Fully paid travel and accommodation
+1
Senior DL Inference Engineer — GPU-Accelerated AI at Scale
Senior DL Inference Engineer — GPU-Accelerated AI at Scale

NVIDIA • United Kingdom

On-site
GBP 110,000 - 160,000
Competitive salaries
Extensive benefits package
Diversity & inclusion
AI Inference Engineer — GPU-Optimized Rust/Python (Equity)
AI Inference Engineer — GPU-Optimized Rust/Python (Equity)

CVFine by Instrovate Technologies • Greater London

On-site
GBP 70,000 - 90,000
Staff Software Engineer, Large-Scale Inference
Staff Software Engineer, Large-Scale Inference

Anthropic • Greater London

Hybrid
GBP 80,000 - 100,000
Competitive compensation
Generous vacation
Flexible working hours
Senior ML Engineer: GPU Inference & Low-Precision Training
Senior ML Engineer: GPU Inference & Low-Precision Training

Nebius • Greater London

On-site
GBP 90,000 - 130,000
Competitive pay
Career growth
Flexibility and ownership
+3
Senior ML Performance Engineer - Real-Time Inference & Scale
Senior ML Performance Engineer - Real-Time Inference & Scale

Odyssey • Greater London

On-site
GBP 70,000 - 90,000
Realtime ML Systems Engineer - High-Performance Inference
Realtime ML Systems Engineer - High-Performance Inference

Inworld AI • United Kingdom

On-site
GBP 140,000 - 200,000
Senior ML Infra Engineer: Scale GPU Clusters & Pipelines
Senior ML Infra Engineer: Scale GPU Clusters & Pipelines

Ellison Institute, LLC • Oxford

Hybrid
GBP 90,000 - 140,000
Competitive salary
25 days annual leave + 8 bank holidays
3 additional days between Christmas &.
+11