ML Systems Engineer - Framework Integration

roofline; Köln; Vor Ort; EUR 80.000 - 110.000; Vollzeit

Zusammenfassung

Roofline is building a Deployment Platform to run models on disruptive edge hardware. As a Systems Engineer, you’ll own the path from a model in a framework to fast code on the target, across every layer, from quantization to final code generation.

You will bring up reference models, fix root causes, set cross-team direction, and help shape the Roofline SDK. You’ll collaborate with the ML and compiler teams and contribute to an open-source ecosystem.

Qualifikationen

• Hands-on experience in AI and embedded systems.
• Degree in Computer Science, Electrical Engineering, or related field.
• Strong C/C++ and Python programming skills.
• Experience with accelerator toolchains for NPUs/DSPs/GPUs.
• Excellent communication and collaboration to align engineers.
• Proven track record shipping improvements and influencing product direction.

Aufgaben

• Own the path from a model in a ML framework to fast code on target hardware, across all software layers.
• Diagnose issues across the stack, root-cause fixes, and ensure robust performance.
• Define contracts and interfaces between layers to keep multiple engineering teams aligned.
• Turn findings into reusable tooling or features to improve the SDK and model deployment.
• Collaborate with open-source communities (e.g., PyTorch) and mentor junior engineers.

Kenntnisse

C/C++

Python

AI & Embedded

Embedded systems

Accelerator toolchain

Ausbildung

Degree in Computer Science or Electrical Engineering

Jobbeschreibung

Roofline is building a Deployment Platform to run any model on disruptive hardware at the edge. As a Systems Engineer, you’ll own the path from a model in a framework to fast code on the target, across every layer in between. You’ll find where things break, fix them at the root, and set the technical direction that keeps our engineering teams aligned.

• The opportunity to grow. Be at the forefront of building and shaping an industry-defining venture. There are plenty of opportunities to learn and evolve.
• The team succeeded. We are building the leading AI compiler team in Europe. Join our future-focused team to contribute to meaningful, disruptive innovations with us.
• The flexibility you need. Whether you need to take extra time off, adjust your schedule, or have other ideas to maximize your productivity, we’ve got your back
• The compensation that rewards. We are looking for world class talent and pay accordingly. We offer equity for every employee since we truly want you to participate in our success.
• The culture you desire. We actively make space to build our culture. We organize dedicated regular events and retreats for the whole team.

• Own the path from a model in a ML framework down to running fast on a target hardware. Work at all levels of the software stack with a wide understanding of everything from quantization to compiler abstractions to final target code generation.
• Bring up reference models using Roofline's deployment tools, pinpoint which component an issue really lives in, and make sure it’s fixed at the root.
• Set technical direction across multiple teams for ML, compiler, runtime, and architecture based on your first-hand data. Define contracts and interfaces between the layers and keep the teams aligned to them.
• Turn your findings into products. Reflect on recurring blockers to craft solutions that benefit our customers and help improve our SDK. Think ahead to make sure that we always support the latest models and applications.
• Interacting with open-source community in the ML space (e.g. PyTorch)
• Raise the level of the engineers around you. Mentor junior engineers and help to maintain the best technical culture for the company.

• Several years of hands-on experience in AI and embedded systems.
• Degree in Computer Science, Electrical Engineering, or related fields.
• Deep practical expertise in C/C++ and Python
• End-to-end experience with an accelerator toolchain for NPUs, DSPs, or GPUs spanning their compiler, runtime, kernel libraries and memory models.
• Strong communication and collaboration skills to align other engineers through clear ideas, abstractions, and design docs.
• Demonstrated technical influence beyond your own deliverables. Have product changes you argued for and got shipped, engineers you've mentored, or practices a team adopted because you established them.
• Ambition and curiosity to solve complex problems, a strong mindset to take ownership and drive our solutions forwards, and a collaborative attitude to foster our culture.

Nice to haves:

• Experience working with hardware or architecture teams, and an understanding of how their approaches to problems and processes differ from software teams’.
• Experience working with PyTorch, ONNX, Tensorflow
• Experience shipping an accelerated model into production under real constraints for applications such as automotive, medical, industrial or consumer where memory budgets, certification and time budgets apply.