C++ ML Inference Runtime Engineer

Semiconductor Engineering; Cambridge; On-site; GBP 65,000 - 105,000; Full time

Job summary

Semiconductor Engineering in Cambridge is seeking a C++ software engineer with experience in ML inference engines, runtime systems, or backend integration frameworks. Experience with LiteRT, TensorFlow Lite, ONNX Runtime or similar technologies is highly valued.

You will understand how AI models execute in practice, including graph processing, operator execution, and memory management, and you will analyse, investigate and resolve complex issues across frameworks, runtimes, compilers, drivers

Qualifications

• C++ software development experience in ML domain.
• Experience with ML inference frameworks such as LiteRT, TensorFlow Lite, ONNX Runtime.
• Understanding of AI model execution concepts (graph processing, operator execution, memory management).

Responsibilities

• Analyse, investigate, diagnose and resolve complex functional or performance issues across frameworks, runtimes, compilers, drivers and hardware abstraction layers.

Skills

C++ Development

ML Inference Frameworks

Backend Integration

Tools

LiteRT

TensorFlow Lite

ONNX Runtime

Job description

Semiconductor Engineering in Cambridge is seeking a C++ software engineer with experience in ML inference engines, runtime systems, or backend integration frameworks. Experience with LiteRT, TensorFlow Lite, ONNX Runtime or similar technologies is highly valued.

You will understand how AI models execute in practice, including graph processing, operator execution, and memory management, and you will analyse, investigate and resolve complex issues across frameworks, runtimes, compilers, drivers