Senior / Staff Software Engineer (AI / Compiler)

JR United Kingdom; High Wycombe; On-site; GBP 145,000 - 167,000; Full time

Job summary

A leading technology company is seeking a Senior / Staff Software Engineer specializing in AI and compiler systems to design high-performance computing infrastructures. The ideal candidate will tackle challenges in optimizing AI workloads and collaborate closely with hardware and ML teams. This position offers a competitive salary starting from £145k, stock options, and is located in a dynamic new office in Kings Cross, London.

Benefits

Competitive salary starting from £145k+

Stock options

Extra £24k/year incentive for 20-minute commute

Qualifications

• 5+ years of experience in HPC, HFT, or AI infrastructure.
• Deep understanding of distributed systems and real-time processing.
• Hands-on experience with ML compilers and optimization techniques.

Responsibilities

• Design and build high-performance systems for AI/ML workloads.
• Optimize for ultra-low latency and real-time inference.
• Identify and resolve performance bottlenecks across the stack.

Skills

C++

Python

Performance Tuning

Distributed Systems

Education

Degree in Computer Science, Engineering, Mathematics, or related field

Tools

LLVM

MLIR

PyTorch

ONNX

OpenXLA

Job description

Social network you want to login/join with:

Senior / Staff Software Engineer (AI / Compiler), High Wycombe

Company Overview

Flux is pioneering a new class of AI accelerators called Optical Tensor Processing Units (OTPUs). We’ve already developed functioning prototypes and are now scaling our operations in London. Our work environment rewards innovation, speed, and bold thinking.

The role

We’re hiring Senior and Staff Software Engineers to build the high-performance computing infrastructure that powers our OTPUs. This role involves rethinking how AI workloads are executed at speed and scale, focusing on software systems that run distributed, low-latency inference across clusters.

You’ll collaborate with hardware and ML teams to optimize every layer of the stack—from model representation and execution to data movement and scheduling. Your work may involve compiler techniques, systems-level tuning, or custom runtime design, playing a critical role in shaping our AI platform’s performance. Ideal candidates have experience in HFT, large-scale scientific compute, or AI infrastructure at a serious scale.

Responsibilities

• Design and build high-performance systems for AI/ML workloads across distributed compute clusters.
• Optimize for ultra-low latency and real-time inference at scale—profiling, tuning, and rewriting critical systems as needed.
• Identify and resolve performance bottlenecks across the stack, including model execution, scheduling, and hardware constraints.
• Collaborate with compiler engineers to improve code generation, execution paths, and memory layouts using tools like LLVM or MLIR.
• Work with hardware teams to ensure software fully leverages OTPU architecture capabilities.
• Extend ML frameworks (e.g., PyTorch, ONNX, OpenXLA) to support performance-critical inference paths.
• Lead design reviews, mentor engineers, and promote best practices in HPC and performance engineering.
• Stay updated on developments in AI infrastructure, compute systems, and compiler tooling.

Skills & Experience

• 5+ years of experience in performance-critical systems in HPC, HFT, large-scale simulation, or AI infrastructure.
• Deep understanding of distributed systems, especially real-time or near real-time data processing.
• Strong programming skills in C++ and Python for performance-sensitive applications.
• Hands-on experience with ML compilers (LLVM, MLIR) and knowledge of runtime and scheduling optimizations.
• Practical knowledge of ML frameworks like PyTorch, ONNX, or OpenXLA, and how to optimize their execution.
• Experience scaling AI workloads across clusters or custom infrastructure, not just standard cloud deployment.
• Strong debugging, profiling, and performance-tuning skills across the stack.
• Degree in Computer Science, Engineering, Mathematics, or a related field.

Details

• Competitive salary starting from £145k+, depending on experience.
• Stock options in a rapidly growing AI company.
• Based in our new 5,000 sq. ft. office in Kings Cross, London.
• Flux hires candidates within a 45-minute commute, offering an extra £24k/year incentive if you live within 20 minutes.