Senior / Staff Software Engineer (AI / Compiler)

JR United Kingdom; Gloucester; On-site; GBP 145,000 - 170,000; Full time

Job summary

A leading company in AI is seeking Senior and Staff Software Engineers in Gloucester to develop high-performance computing infrastructure for machine learning applications. You will tackle complex problems involving distributed systems and low-latency inference, contributing to pioneering technologies in a collaborative environment.

Benefits

Competitive salary

Stock options

Incentives for short commutes

Qualifications

• 5+ years in performance-critical systems, HPC, HFT, or AI infrastructure.
• Strong programming skills in C++ and Python.
• Experience with ML compilers and scaling AI workloads across clusters.

Responsibilities

• Design and build high-performance systems for AI/ML workloads.
• Optimize for low latency and real-time inference.
• Collaborate with compiler engineers and hardware teams.

Skills

C++

Python

Debugging

Profiling

Performance-tuning

Education

Degree in Computer Science

Degree in Engineering

Degree in Mathematics

Tools

LLVM

MLIR

PyTorch

ONNX

OpenXLA

Job description

Social network you want to login/join with:

Senior / Staff Software Engineer (AI / Compiler), Gloucester

Company Overview

Flux is pioneering a new class of AI accelerators called Optical Tensor Processing Units (OTPUs). We’ve already developed functioning prototypes and are now scaling our operations in London. Our work environment rewards innovation, speed, and bold thinking.

The role

We’re hiring Senior and Staff Software Engineers to build the high-performance computing infrastructure that powers our OTPUs. This role involves rethinking how AI workloads are executed at speed and scale, focusing on software systems for distributed, low-latency inference across clusters.

Responsibilities

• Design and build high-performance systems for running AI/ML workloads across distributed compute clusters
• Optimize for ultra-low latency and real-time inference at scale—profiling, tuning, and rewriting critical systems as needed
• Identify and resolve performance bottlenecks across the stack, from model execution and scheduling to hardware-level constraints
• Collaborate with compiler engineers to improve code generation, execution paths, and memory layouts using tools like LLVM or MLIR
• Work with hardware teams to ensure the software stack fully leverages OTPU architecture
• Extend ML frameworks (e.g., PyTorch, ONNX, OpenXLA) to support performance-critical inference paths
• Lead design reviews, mentor engineers, and promote best practices in HPC and performance engineering
• Stay updated on developments in AI infrastructure, compute systems, and compiler tooling

Skills & Experience

• 5+ years of experience in performance-critical systems in HPC, HFT, large-scale simulation, or AI infrastructure
• Deep understanding of distributed systems, especially real-time or near real-time data processing
• Strong programming skills in C++ and Python for performance-sensitive applications
• Experience with ML compilers (e.g., LLVM, MLIR), runtime, and scheduling optimizations
• Knowledge of ML frameworks like PyTorch, ONNX, or OpenXLA, and their execution optimization
• Experience scaling AI workloads across clusters or custom infrastructure
• Strong debugging, profiling, and performance-tuning skills
• Degree in Computer Science, Engineering, Mathematics, or a related field

Details

• Competitive salary from £145k+, depending on experience
• Stock options in a rapidly growing AI company
• Based in our new 5,000 sq. ft. office in Kings Cross, London
• Flux hires candidates within a 45-minute commute, with an extra £24k/year incentive for those living within 20 minutes