Sr ML Runtime Engineer

Fractile; Greater London; Hybrid; GBP 60,000 - 80,000; Full time

Job summary

A cutting-edge AI technology company is seeking an experienced developer to create the Rust runtime for their AI acceleration hardware. This role offers the chance to work with top engineers on significant machine learning projects and collaborate on the latest advancements in AI technology. Candidates should have excellent Rust and Python skills, along with a strong understanding of ML workloads and related experience. The position is based in either London or Bristol.

Qualifications

• Proven experience in ML software ecosystems.
• Good understanding of ML workloads and inference deployment challenges.
• 5+ years of industry experience.

Responsibilities

• Develop the Rust runtime for innovative AI acceleration hardware.
• Integrate runtime with open source projects like PyTorch and vLLM.
• Collaborate in a hardware-software co-design methodology.

Skills

Rust programming

Python programming

Machine learning software ecosystem

Creative mindset

Education

Degree in Computer Science, Electronic Engineering, Maths, Physics, or related field

Tools

Industry standard development tools

Job description

At Fractile, we’re taking a revolutionary approach to computing to run the world’s largest language models 100x faster than existing systems. Our fast-growing team is working at the cutting edge of the latest AI developments in both hardware and software. Want to get involved?

You can be based in either our London office or Bristol, the choice is yours.

In this role, you will:

• Develop the Rust runtime for Fractile’s innovative AI acceleration hardware
• Integrate that runtime with key open source projects like PyTorch, vLLM, and SGLang
• Work with hardware, lower-level software, and ML engineers in a highly collaborative hardware-software co-design methodology

It would be great if you have:

• Proven experience of working with major ML software ecosystem projects
• A good understanding of the latest ML workloads and inference deployment challenges
• Excellent Rust and Python skills and solid experience of industry standard development tools and technologies
• A creative and innovative mindset, and a willingness to take ownership and drive results in a fast-paced environment
• Computer Science, Electronic Engineering, Maths, Physics, or related degree and 5+ years of industry experience

You may also have:

• Experience of working with GPUs or other machine learning accelerators
• Previous experience in a startup or small team environment