Senior / Staff Software Engineer (AI / Compiler)

JR United Kingdom; Swindon; On-site; GBP 145,000 - 167,000; Full time

Job summary

A leading AI company is seeking Senior and Staff Software Engineers to develop high-performance computing infrastructure for their Optical Tensor Processing Units (OTPUs). You'll work closely with hardware and ML teams, tackling challenges in AI workload optimization and designing systems for distributed environments. Ideal candidates will possess a strong foundation in C++, Python, and performance-critical systems, thriving in an innovative and fast-paced setting.

Benefits

Stock options in a growing AI company

Salary incentive for local candidates

Qualifications

• 5+ years of experience in HPC, HFT, or AI infrastructure.
• Deep understanding of distributed systems.
• Expertise in debugging and performance tuning.

Responsibilities

• Design and build high-performance AI/ML systems.
• Optimize for low-latency and real-time inference.
• Collaborate with hardware teams and compiler engineers.

Skills

Performance-critical systems

Real-time data processing

C++

Python

ML compilers

Machine Learning frameworks

Performance-tuning

Education

Degree in Computer Science, Engineering, Mathematics

Tools

LLVM

MLIR

PyTorch

ONNX

OpenXLA

Job description

Social network you want to login/join with:

Senior / Staff Software Engineer (AI / Compiler), Swindon, Wiltshire

Company Overview

Flux is pioneering a new class of AI accelerators called Optical Tensor Processing Units (OTPUs). We’ve already developed functioning prototypes and are now scaling our operations in London. Our work environment rewards innovation, speed, and bold thinking.

The role

We’re hiring Senior and Staff Software Engineers to build the high-performance computing infrastructure that powers our OTPUs. This role involves rethinking how AI workloads are executed at speed and scale, focusing on software systems for distributed, low-latency inference across clusters.

You’ll collaborate with hardware and ML teams to optimise the stack—from model representation and execution to data movement and scheduling. Whether through compiler techniques, systems-level tuning, or custom runtime design, you’ll shape the performance layer of our AI platform. Ideal candidates think in microseconds and have experience in HFT, large-scale scientific compute, or AI infrastructure.

Responsibilities include:

• Designing and building high-performance AI/ML systems across distributed clusters
• Optimising for ultra-low latency and real-time inference
• Resolving performance bottlenecks at all stack levels
• Collaborating with compiler engineers (LLVM, MLIR)
• Working with hardware teams to leverage OTPU capabilities
• Extending ML frameworks like PyTorch, ONNX, OpenXLA
• Leading design reviews, mentoring, and promoting best practices
• Staying updated on AI infrastructure and compiler tooling advancements

Skills & Experience required:

• 5+ years in performance-critical systems (HPC, HFT, large-scale simulation, AI infrastructure)
• Deep understanding of distributed systems and real-time data processing
• Strong C++ and Python skills
• Experience with ML compilers (LLVM, MLIR)
• Knowledge of ML frameworks and optimisation techniques
• Experience scaling AI workloads on custom infrastructure
• Debugging, profiling, performance-tuning expertise
• Degree in Computer Science, Engineering, Mathematics, or related field

Details

• Salary: £145k+ depending on experience
• Stock options in a growing AI company
• Based in our office in Kings Cross, London
• Candidates within a 45-minute commute considered; living within 20 minutes offers an additional £24k/year incentive