AI Compiler Optimization Engineer

Huawei Technologies Research & Development (UK) Ltd

City of Edinburgh

On-site

GBP 85,000 - 110,000

Full time

14 days+

Get more replies from employers

Send a job-specific resume in minutes.

Benefits offered by this job

33 days annual leave entitlement peryr

Group Pension

Life insurance

Private medical insurance

Medical expense claim scheme

Employee Assistance Program

Cycle to work scheme

Company sports club and social events

Extra learning & development time

Job summary

Huawei Research and Development UK Limited in Edinburgh is seeking a skilled AI Compiler Optimization Engineer to boost AI model inference performance on CPU and CPU/XPU hybrid systems, using advanced compiler techniques.

You will profile frameworks such as TensorFlow, PyTorch and ONNX, optimize graph execution, and contribute to open research with practical insights and publications.

Qualifications

Proficiency in C/C++ and compiler infrastructure (LLVM/MLIR).
Deep understanding of AI model architectures and inference workflows.
Experience with performance profiling tools (e.g., perf, TensorBoard, VTune).
Familiarity with CPU/XPU hardware architectures and optimization techniques.

Responsibilities

Compiler-Based Performance Optimization: Implement compiler techniques (e.g., MLIR level optimizations, LLVM backend optimizations) to enhance inference performance on CPU and CPU/XPU hybrid systems.
AI Model Profiling & Framework Optimization: Profile end-to-end inference workflows on frameworks like TensorFlow, PyTorch, ONNX, and llama.cpp to identify hotspots and bottlenecks.
Research & Insight Development: Track and analyze the latest advancements in AI & compiler research; produce actionable insight reports summarizing trends and benchmarks.

Skills

C/C++

AI architectures

Performance profiling

Education

BSc/MSc/MSci in CS

Tools

LLVM

MLIR

Perf

TensorBoard

VTune

Job description

About Huawei Research and Development UK Limited

Founded in 1987, Huawei is a leading global provider of information and communications technology (ICT) infrastructure and smart devices. We have 207,000 employees and operate in over 170 countries and regions, serving more than three billion people around the world.

Our vision and mission is to bring digital to every person, home and organization for a fully connected, intelligent world. To this end, we will drive ubiquitous connectivity and promote equal access to networks; bring cloud and artificial intelligence to all four corners of the earth to provide superior computing power where you need it, when you need it; build digital platforms to help all industries and organizations become more agile, efficient, and dynamic; redefine user experience with AI, making it more personalized for people in all aspects of their life, whether they’re at home, in the office, or on the go.

This spirit of innovation has led Huawei to work in close partnership with leading academic institutions in the UK to develop and refine the latest technologies. With a shared commitment to innovation and progress, both parties have worked together to achieve common goals and establish a strong partnership. The partnership between UK and Huawei help to develop the technologies of the future that will transform the way we all communicate, work and live.

For the past 30 years we have maintained an unwavering focus, rejecting shortcuts and easy opportunities that don't align with our core business. With a practical approach to everything we do, we concentrate our efforts and invest patiently to drive technological breakthroughs.

This strategic focus is a reflection of our core values:

Staying customer-centric,
Inspiring dedication,
Persevering,
Growing by reflection.

Huawei Research and Development UK Limited Overview

Huawei’s vision is a fully connected, intelligent world. To achieve this, we work to inspire passion for basic research around the world. Our combined passion drives development across the global innovation value chain. Huawei has the largest Research and Development organization in the world with 96,000+ employees in research centers around the globe. In the UK, we already have design centers in Cambridge, London, Edinburgh and Ipswich. We continue to explore and define new research directions and new services. We have expanded our collaborations with academic researchers; researched new network architectures, integration of communications and key enabling technologies; and developed the fundamental theories of these technologies. We invite you to join us on this exciting journey and drive your career forward.

Job Summary

We are seeking a skilled AI Compiler Optimization Engineer to optimize AI model inference performance through advanced compiler technologies. You will focus on performance tuning for CPU or hybrid CPU/XPU heterogeneous architectures, profiling AI frameworks to discover new optimization opportunities, and delivering cutting-edge insights from industry research.

Key Responsibilities:

Compiler-Based Performance Optimization:

Implement compiler techniques (e.g., MLIR level optimizations, LLVM backend optimizations) to enhance inference performance on CPU and CPU/XPU hybrid systems
Optimize JIT level compute graphs with operator fusion, memory allocation and etc. for latency/throughput improvements
Preferred: Experience with LLVM/MLIR development

AI Model Profiling & Framework Optimization:

Profile end-to-end inference workflows on frameworks like TensorFlow, PyTorch, ONNX, and llama.cpp to identify hotspots and bottlenecks
Propose and implement optimization strategies (e.g., kernel tuning, graph-level optimizations)
Preferred: Experience optimizing models on multiple AI frameworks

Research & Insight Development:

Track and analyze the latest advancements in AI & compiler research (academic papers, open-source projects)
Produce actionable insight reports summarizing trends, benchmarks, and potential optimizations
Preferred: Strong technical writing skills with prior publications or reports

This job description is only an outline of the tasks, responsibilities and outcomes required of the role. The jobholder will carry out any other duties as may be reasonably required by his/her line manager. The job description and personal specification may be reviewed on an ongoing basis in accordance with the changing needs of Huawei Research and Development UK Limited.

Person Specification:

Required:

Proficiency in C/C++ and compiler infrastructure (LLVM, MLIR, or similar)
Deep understanding of AI model architectures and inference workflows
Experience with performance profiling tools (e.g., perf, TensorBoard, VTune)
Familiarity with CPU/XPU hardware architectures and optimization techniques
Strong analytical and problem-solving skills

Desired:

BSc/MSc/MSci in CS
Contributions to open-source compiler projects (LLVM/MLIR communities)
Experience with heterogeneous computing (CPU/GPU/XPU)
Published work or technical blogs on AI/compiler optimization topics
Good at self-learning, courageous to explore new things, strong in practical skill

What we offer