AI Inference Tooling Engineer

Modular

City of Edinburgh

Hybrid

GBP 83,000 - 150,000

Full time

14 days+
Application generator

An application made for this job — a tailored resume and cover letter that speak straight to the posting.

Get past ATS filters

Benefits offered by this job

Amazing Team
World-class Benefits
Competitive Compensation
Team Building Events

Job summary

Modular is building the MAX AI inference stack and developer tooling to empower engineers building models and kernels. You will develop tools for profiling, debugging, and optimization across a growing hardware landscape.

Based in the UK, you can work in a hybrid mode with Edinburgh on-site days and remote flexibility for senior roles. Onboarding is conducted in person at the office. The role focuses on developer experience and tooling excellence.

Qualifications

  • Passion for exceptional developer experiences and tooling.
  • Experience designing, building, and shipping developer tools or observability systems.
  • Fluency in C++, Rust, Go and one user-facing language such as Python (Mojo a plus).
  • Experience measuring performance via profiling, tracing, or benchmarking.
  • Strong written communication and ability to work independently in a distributed team.
  • User-focused mindset, understanding users' workflows and productivity.

Responsibilities

  • Enhance developer experience by creating tools for traditional and agentic workflows.
  • Surface data across the AI stack and support multiple hardware platforms.
  • Design and maintain profiling, tracing, debuggers, metrics, and dashboards.
  • Create agent-native tooling and build workflows for models and systems.
  • Strengthen tooling interfaces across MAX, Mojo, and driver APIs.
  • Participate in design discussions and code reviews to uphold standards.

Skills

Developer experience
Tooling design
Systems languages
Python
Performance profiling
Clear communication
User-focused mindset

Job description

Modular is building the MAX AI inference stack and developer tooling to empower engineers building models and kernels. You will develop tools for profiling, debugging, and optimization across a growing hardware landscape.

Based in the UK, you can work in a hybrid mode with Edinburgh on-site days and remote flexibility for senior roles. Onboarding is conducted in person at the office. The role focuses on developer experience and tooling excellence.

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

AI Inference Tools Engineer
AI Inference Tools Engineer

Modular • City of Edinburgh

Hybrid
GBP 83,000 - 150,000
Amazing Team
World-class Benefits
Competitive Compensation
+1
Senior Inference Engineer - AI APIs
Senior Inference Engineer - AI APIs

AssemblyAI • United Kingdom

On-site
GBP 120,000 - 145,000
AI Runtime Engineer - High-Performance ML Platform
AI Runtime Engineer - High-Performance ML Platform

Modular • City of Edinburgh

On-site
GBP 83,000 - 124,000
Amazing Team.
World-class Benefits.
Competitive Compensation.
+1
AI Inference Optimizations Engineer (MLIR/LLVM)
AI Inference Optimizations Engineer (MLIR/LLVM)

microTECH Global Limited • City of Edinburgh

Hybrid
GBP 90,000 - 120,000
Staff AI Engineer – Developer Tools (Remote)
Staff AI Engineer – Developer Tools (Remote)

Jobgether • United Kingdom

Hybrid
GBP 120,000 - 180,000
Flexible work location
Remote work abroad up to 30 days per y
Medical insurance allowance
+5
Developer Experience Architect – AI Inference Tools
Developer Experience Architect – AI Inference Tools

Fractile Ltd • Greater London

Hybrid
GBP 70,000 - 120,000
Equity
Hybrid work model
Competitive salary
Senior AI Platform & Infrastructure Engineer
Senior AI Platform & Infrastructure Engineer

Lenovo • City of Edinburgh

Hybrid
GBP 70,000 - 90,000
Opportunities for career advancement
Diverse training programs
Performance-based rewards
+3
AI Runtime Engineer
AI Runtime Engineer

Modular • City of Edinburgh

On-site
GBP 83,000 - 124,000
Amazing Team.
World-class Benefits.
Competitive Compensation.
+1
Senior Performance Engineer — AI Inference & Systems Optimizer
Senior Performance Engineer — AI Inference & Systems Optimizer

CommonAI CIC • Cambridge

On-site
GBP 70,000 - 100,000
Competitive salary
Pension
Professional development
+2
AI Inference Engineer — GPU-Optimized Rust/Python (Equity)
AI Inference Engineer — GPU-Optimized Rust/Python (Equity)

CVFine by Instrovate Technologies • Greater London

On-site
GBP 70,000 - 90,000