Senior C++ ML Framework & Runtime Engineer

CamWebDir; United Kingdom; Hybrid; GBP 85,000 - 120,000; Full time

Job summary

Arm is seeking an Experienced Machine Learning Framework/Runtime Software Engineer to advance C++ based ML inference engines and runtimes. You will work across runtime, compiler, driver and hardware teams to design, develop, integrate, test, and optimise solutions in a large modular codebase, focusing on memory management, graph execution and backend integration.

You will contribute to end-to-end AI software stack from framework execution to hardware acceleration, with opportunities to learn,

Qualifications

• Strong C++ software development experience in ML inference or runtime systems.
• Experience with ML inference frameworks such as LiteRT, TensorFlow Lite or ONNX Runtime.
• Understanding of graph execution, memory management and backend integration.

Responsibilities

• Analyze and diagnose complex issues across frameworks, runtimes, compilers, drivers, and hardware abstraction layers.
• Collaborate with runtime, compiler, driver, and hardware teams to design, develop, test, and optimise AI solutions.
• Contribute to end-to-end AI software stack from framework execution to hardware acceleration.

Skills

C++ development

ML inference engines

runtime systems

backend integration

TensorFlow Lite

ONNX Runtime

LiteRT

Tools

LiteRT

TensorFlow Lite

ONNX Runtime

Vulkan

OpenCL

Job description

Arm is seeking an Experienced Machine Learning Framework/Runtime Software Engineer to advance C++ based ML inference engines and runtimes. You will work across runtime, compiler, driver and hardware teams to design, develop, integrate, test, and optimise solutions in a large modular codebase, focusing on memory management, graph execution and backend integration.

You will contribute to end-to-end AI software stack from framework execution to hardware acceleration, with opportunities to learn,