ML Runtime Engineer (Mid-Level and Senior)

Fractile; Bristol (VA); On-site; USD 120,000 - 160,000; Full time

Job summary

A revolutionary tech company based in the United States is seeking a Senior ML Runtime Engineer to work on integrating innovative AI acceleration hardware with leading open source projects like PyTorch. The candidate should have strong Python and Rust skills with over 5 years of industry experience. This position offers the opportunity to collaborate in a fast-paced environment and drive results on ground-breaking AI developments.

Qualifications

• 5+ years of industry experience in ML or related fields.
• Excellent understanding of ML workloads and inference deployment challenges.
• Experience with GPUs or other machine learning accelerators.

Responsibilities

• Integrate Fractile's AI acceleration hardware with open source projects.
• Develop high-performance Rust runtime.
• Collaborate with hardware, software, and ML engineers.

Skills

Python

Rust

Working with ML software ecosystem projects

Collaboration in hardware-software co-design

Education

Computer Science degree

Electronic Engineering degree

Maths degree

Physics degree

Tools

Industry standard development tools

Job description

At Fractile, we’re taking a revolutionary approach to computing to run the world’s largest language models 100x faster than existing systems. Our fast-growing team is working at the cutting edge of the latest AI developments in both hardware and software. Want to get involved?

We are looking for Senior ML Runtime Engineers with experience of key ML software ecosystem components to work on inference server integrations and the runtime stack of our ground-breaking AI accelerators. You can be based in either our London office or Bristol, the choice is yours.

In this role, you will:

• Integrate Fractile's innovative AI acceleration hardware with leading open source projects like PyTorch, vLLM, and SGLang
• Develop our underlying high-performance Rust runtime
• Work with hardware, lower-level software, and ML engineers in a highly collaborative hardware-software co-design methodology

It would be great if you have:

• Proven experience of working with major ML software ecosystem projects
• A good understanding of the latest ML workloads and inference deployment challenges
• Excellent Python and Rust skills and solid experience of industry standard development tools and technologies
• A creative and innovative mindset, and a willingness to take ownership and drive results in a fast-paced environment
• Computer Science, Electronic Engineering, Maths, Physics, or related degree and 5+ years of industry experience

You may also have:

• Experience of working with GPUs or other machine learning accelerators
• Previous experience in a startup or small team environment

Interested in building your career at Fractile? Get future opportunities sent straight to your email.