AI Compiler Engineer (Senior Staff)

RooflineAI GmbH; Germany (OH); On-site; USD 180,000 - 290,000; Full time

Benefits offered by this job

Equity for every employee

On-site team retreats

Flexible time off

Job summary

RooflineAI is building a software development kit to run models on disruptive edge hardware. We seek engineers passionate about technology to design and implement new components in our stack, collaborating with world-class engineers to enable AI applications across heterogeneous hardware.

You will design core compiler components, own architecture decisions, and explore optimization techniques to push performance across CPUs, GPUs, and NPUs.

Qualifications

• 10+ years of LLVM/compiler experience with ownership of major components or architectures.
• Experience targeting CPUs, GPUs, or NPUs/custom accelerators, including performance optimization.
• Expert knowledge and hands-on experience in C++ and Python.
• Hands-on experience with MLIR or similar compiler frameworks for tensor/graph workloads.
• Proven understanding of software engineering principles, data structures, design patterns, and algorithms.
• Desire to work with a growing community of open-source contributors.
• Ambition and curiosity to solve complex problems, ownership mindset to drive solutions, and collaborative attitude.

Responsibilities

• Design and implement core components of our next generation compiler built upon MLIR.
• Set technical direction by owning architecture and design decisions across the software stack.
• Explore, plan, and implement novel optimization techniques.
• Iterate with peers on customers’ teams to design the best compiler technology and user experience and present results to management.
• Lead technical development and roadmaps for your part of the stack, collaborating with senior and junior team members.
• Align internal and external stakeholders on big changes and future developments.
• Drive knowledge sharing through documentation, design reviews, and cross-team collaboration to accelerate decisions.
• Expand a growing open-source community to foster an ecosystem around Roofline.
• Anticipate technical trends and prepare software to handle them.

Skills

LLVM compiler experience

CPU/GPUs/NPUs accelerators

C++ and Python

MLIR or similar compiler frameworks

Software engineering principles

Open-source contributions

Ownership and accountability

Collaborative attitude

Tools

MLIR

Job description

Roofline is building a software development kit to run any model on disruptive hardware at the edge. We are looking for talented and ambitious engineers that are passionate about technology to design and implement new components in our software stack. You will work alongside other world class engineers to enable the full spectrum of AI applications across heterogeneous hardware platforms.

Why us?

• The opportunity to grow. Be at the forefront of building and shaping an industry-defining venture. There are plenty of opportunities to learn and grow
• The team to succeed. We are building the leading AI compiler team in Europe. Join our future-focused team to contribute to meaningful, disruptive innovations with us
• The flexibility you need. Whether you need to take extra time off, adjust your schedule, or have other ideas to maximize your productivity, we’ve got your back
• The compensation that rewards. We are looking for world class talent and pay accordingly. We offer equity for every employee since we truly want you to participate in our success
• The culture you desire. We actively make space to build our culture. We bring you on site regularly and organize dedicated retreats for the whole team

Your mission

• Design and implement core components of our next generation compiler built upon MLIR
• Set technical direction by owningkeyarchitecture and design decisions across the software stack
• Explore, plan, and implement novel optimization techniques
• Iterate with peers on customers’ teams to design the best compiler technology and user experience possible and present results to higher management
• Lead technical development and roadmaps for your part of the stack, working with senior and junior team members
• Align internal and external stakeholders on big changes and future long time developments
• Drive knowledge sharing through high-quality documentation, design reviews, and cross-team context sharing to accelerate team-wide decision-making and technical growth
• Expand a growing open-source community to foster a strong ecosystem around Roofline
• Anticipate technical trends and make our software ready to handle them

Your profile

• 10+ years of compiler experience (LLVM), including ownership of major components or architectures
• Experience targeting CPUs, GPUs, or NPUs/ custom accelerators, including performance optimization
• Expert knowledge and hands-on experience in C++ and Python
• Hands-on experience with MLIR or similar compiler frameworks for tensor/graph workloads
• Proven understanding of software engineering principles, data structures, design patterns, and algorithms
• Desire to work with a growing community of open-source contributors
• Ambition and curiosity to solve complex problems, a strong mindset to take ownership of your tasks to drive our solutions forwards, and collaborative attitude to foster our culture

• 10+ years of compiler experience (LLVM), including ownership of major components or architectures
• Experience targeting CPUs, GPUs, or NPUs/ custom accelerators, including performance optimization
• Expert knowledge and hands-on experience in C++ and Python
• Hands-on experience with MLIR or similar compiler frameworks for tensor/graph workloads
• Proven understanding of software engineering principles, data structures, design patterns, and algorithms
• Desire to work with a growing community of open-source contributors
• Ambition and curiosity to solve complex problems, a strong mindset to take ownership of your tasks to drive our solutions forwards, and collaborative attitude to foster our culture

Nice to haves:

• Meaningful contributions to open-source compiler communities
• Knowledge of AI algorithms and compiling to AI workloads to relevant hardware
• Knowledge of data motion networks, data flow programming models, and optimized AI libraries

About us

At RooflineAI, we enable the edge-AI products you dream of. Our mission is simple: To bring the power of chips into the hands of innovators, and to make it radically easier to use cutting-edge AI models on the best hardware.