ML Systems Engineer – Framework Integration

RooflineAI GmbH; Köln; On-site; EUR 90,000 - 120,000; Full time

Benefits offered by this job

Equity for every employee

Regular events and team retreats

Job summary

RooflineAI GmbH is developing a deployment platform to run models on edge hardware. As a Systems Engineer, you’ll own the path from a model in a framework to fast code on the target, across every layer in between, tackling root causes from quantization to compiler abstractions.

You will define contracts across ML, compiler, runtime, and architecture teams, bring up reference models, and mentor engineers while contributing to a cutting-edge edge AI stack.

Qualifications

• Several years of hands-on experience in AI and embedded systems.
• Degree in Computer Science, Electrical Engineering, or related fields.
• Deep practical expertise in C/C++ and Python.
• End-to-end experience with an accelerator toolchain for NPUs, DSPs, or GPUs spanning their compiler, runtime, kernel libraries and memory models.
• Demonstrated technical influence beyond your own deliverables; shipped product changes or mentored teams.

Responsibilities

• Own the path from a model in a ML framework to fast code on target hardware across the software stack.
• Bring up reference models using Roofline's deployment tools and diagnose root causes.
• Set technical direction across ML, compiler, runtime, and architecture teams; define interfaces and contracts.
• Turn findings into products; refine SDK and support latest models and applications.
• Interact with open-source ML communities (e.g., PyTorch) to influence direction.
• Mentor junior engineers and help foster strong technical culture.

Skills

AI in embedded systems

C/C++

Python

Accelerator toolchain

Education

BS in CS/EE

Tools

PyTorch

ONNX

TensorFlow

Job description

Full-time

Who we are

Roofline is building a Deployment Platform to run any model on disruptive hardware at the edge. As a Systems Engineer, you’ll own the path from a model in a framework to fast code on the target, across every layer in between. You’ll find where things break, fix them at the root, and set the technical direction that keeps our engineering teams aligned.

Why us?

• The opportunity to grow. Be at the forefront of building and shaping an industry-defining venture. There are plenty of opportunities to learn and evolve.
• The team succeeded. We are building the leading AI compiler team in Europe. Join our future-focused team to contribute to meaningful, disruptive innovations with us.
• The flexibility you need. Whether you need to take extra time off, adjust your schedule, or have other ideas to maximize your productivity, we’ve got your back
• The compensation that rewards. We are looking for world class talent and pay accordingly. We offer equity for every employee since we truly want you to participate in our success.
• The culture you desire. We actively make space to build our culture. We organize dedicated regular events and retreats for the whole team.

Your mission

• Own the path from a model in a ML framework down to running fast on a target hardware.Work at all levels of the software stack with a wide understanding of everything from quantization to compiler abstractions to final target code generation.
• Bring up reference models using Roofline's deployment tools, pinpoint which component an issue really lives in, and make sure it’s fixed at the root.
• Set technical direction across multiple teams for ML, compiler, runtime, and architecture based on your first-hand data. Define contracts and interfaces between the layers and keep the teams aligned to them.
• Turn your findings into products. Reflect on recurring blockers to craft solutions that benefit our customers and help improve our SDK. Think ahead to make sure that we always support the latest models and applications.
• Interacting with open-source community in the ML space (e.g. PyTorch)
• Raise the level of the engineers around you. Mentor junior engineers and help to maintainthe best technical culture for the company.

Your profile

• Severalyears of hands-on experience in AI and embedded systems.
• Degree in Computer Science, Electrical Engineering, or related fields.
• Deep practical expertise in C/C++ and Python
• End-to-end experience with an accelerator toolchain for NPUs, DSPs, or GPUs spanning their compiler, runtime, kernel libraries and memory models. Strong communication and collaboration skills to align other engineers through clear ideas, abstractions, and design docs.
• Demonstrated technical influence beyond your own deliverables. Have product changes you argued for and got shipped, engineers you've mentored, or practices a team adopted because you established them.
• Ambition and curiosity to solve complex problems, a strong mindset to take ownership and drive our solutions forwards, and a collaborative attitude to foster our culture.

Nice to haves:

• Experience working with hardware or architecture teams, and an understanding of how their approaches to problems and processes differ from software teams’.
• Experience working with PyTorch, ONNX, Tensorflow
• Experience shipping an accelerated model into production under real constraints for applications such as automotive, medical, industrial or consumer where memory budgets, certification and time budgets apply.

About us

At RooflineAI, we enable the edge-AI products you dream of. Our mission is simple: To bring the power of chips into the hands of innovators, and to make it radically easier to use cutting-edge AI models on the best hardware.

Ready to be part of our journey?