AI Runtime / Low-level Software Engineer

Kalray; France; Sur place; EUR 70 000 - 110 000; Plein temps

Avantages offerts par ce poste

RSU / stock options

Paid leave RTT

Mobility incentives

Generous paternity leave

Team activities

Résumé du poste

Kalray is seeking an AI Runtime / Low-Level Software Engineer to own the offload runtime for inference workloads on our custom RISC-V AI accelerator, interfacing with an x86 host. You will collaborate with AI, hardware, and compiler teams to drive the stack from emulation to production silicon.

You will develop and optimize the device lifecycle, scheduling, memory movement, and host-accelerator communication while maintaining robust CI tests and emulated environments.

Qualifications

• MSc or BAC+5 in Computer Science, Embedded Systems or related field.
• 5+ years of experience in low-level software development, embedded systems, runtime development or systems programming.
• Strong ownership mindset and autonomy to drive complex software end-to-end.

Responsabilités

• Develop and optimize the runtime for offloaded inference workloads and host-to-device communication.
• Own the performance-critical path including scheduling, memory movement and data flow.
• Profile, analyze and optimize runtime performance to reduce latency and bottlenecks.
• Design and maintain runtime APIs for AI compiler and serving layers.
• Ensure PCIe communication path works in emulation and production silicon; support CI/CD and automated tests.
• Collaborate with AI, hardware and compiler teams to improve real-world AI performance.
• Contribute to reliability and continuous improvement of the AI acceleration software stack.

Connaissances

C/C++ systems programming

Linux systems programming

Parallel programming

Embedded software

RISC-V cross-compilation

PCIe fundamentals

OpenAMP remoteproc rpmsg virtio

Linux internals

Performance profiling

Formation

MSc or BAC+5 in Computer Science/Engineering

Outils

QEMU

Description du poste

AI Runtime / Low-level Software Engineer

Kalray is a European leader in hardware acceleration, with full-stack acceleration expertise: from silicon to complete system.

Our MPPA® (Massively Parallel Processor Array) architecture is the foundation of Kalray’s processor (30+ patent families, 15+ years of development) and acceleration cards that combine processing power, flexibility, and energy efficiency.

Our mission is to deliver open data-efficient hardware accelerators to power next generation of data-intensive, AI-driven systems and infrastructures. We offer off-the-shelf processors, acceleration cards, and specialized processor development.

With over 130 employees and presence in France and Romania, Kalray is backed by top-tier investors and publicly listed on Euronext Growth. You’ll be part of a pioneering team that is shaping the future of computing with cutting-edge processor architecture, software-defined solutions, and next-generation acceleration platforms.

We offer a fast-paced, inclusive, and collaborative environment where ambitious experienced professionals and young talents can thrive—while enjoying the positive and inspiring lanscape of the Alps or the Côte d’Azur. You can learn more about us on our website, follow us on LinkedIn.

As an AI Runtime / Low-Level Software Engineer, you will own the offload runtime layer that enables inference workloads to run efficiently on our custom RISC-V AI accelerator from an x86 host.

You will join our AI & Compute team, which is building a full-stack GenAI inference platform, from serving to silicon: LLM Serving → AI Compilation → Runtime / Offload → Optimized AI Kernel Libraries

You will develop the Low-Level software stack responsible for device lifecycle management, scheduling and workload dispatch, high-performance host-to-device communication, and the runtime APIs exposed to compiler and serving layers. You will build this stack end-to-end on an open software foundation and collaborate closely with hardware, compiler and AI serving teams to drive the solution from emulation to production silicon.

Your main responsibilities will include:

• Develop and optimize the runtime responsible for executing offloaded inference workloads, from the host offload API to the accelerator firmware.
• Own the performance-critical path, including scheduling, dispatch, memory movement and data flow between the host and the accelerator.
• Profile, analyze and optimize runtime performance by identifying bottlenecks related to latency, memory transfers and execution efficiency.
• Design and maintain clean runtime APIs exposed to AI compiler and serving layers, enabling efficient workload execution on the accelerator.
• Integrate and validate the real PCIe communication path while maintaining emulation environments as CI-tested development platforms.
• Develop engineering foundations including CI/CD pipelines, automated smoke tests on emulated hardware and strong quality standards.
• Collaborate with AI Inference, hardware and architecture teams to influence technical decisions and improve real-world AI performance.
• Contribute to the continuous improvement and reliability of the complete AI acceleration software stack.

WHAT WE ARE LOOKING FOR:

Technical skills:

• Strong experience in C and/or C++ systems programming on Linux, within large and complex codebases.
• Strong knowledge of parallel and concurrent programming, including threads, memory movement, profiling and performance optimization.
• Experience with embedded software, firmware or bare-metal development, ideally with technologies such as OpenAMP, remoteproc, rpmsg, virtio and shared-memory communication models.
• Good understanding of Linux internals, including concepts such as mmap, sysfs and the Linux device model, as well as PCIe fundamentals (BARs, DMA).
• Experience with RISC-V (or similar ISA), cross-compilation and low-level debugging across the hardware/software boundary.

Nice to have:

• Experience with the GenAI / LLM inference ecosystem, such as vLLM, or AI compilation technologies such as MLIR/LLVM.
• Experience developing kernel drivers (PCIe, remoteproc) and working with QEMU or hardware emulation environments.
• Experience with CI/CD systems targeting hardware or emulation platforms.
• Experience with high-performance data-plane development, including DMA and zero-copy techniques

Profile:

• MSc or Engineering degree (BAC+5) in Computer Science, Embedded Systems, Computer Engineering or related field.
• 5+ years of experience in low-level software development, embedded systems, runtime development or systems programming.
• Strong ownership mindset and autonomy with the ability to drive a complex software component end-to-end and make sound technical decisions.
• Strong systems-thinking ability, understanding the complete chain from AI serving and compiler layers down to runtime, firmware and hardware.
• Performance-oriented mindset with intuition for identifying where cycles, memory copies and bottlenecks impact execution.
• Rigorous approach to software quality, automation, reproducibility and reliable engineering practices.
• Strong collaboration and communication skills, with the ability to work closely with multidisciplinary teams.
• Comfortable working in an international, fast-evolving startup environment.

KALRAY is committed to creating a diverse and inclusive environment, and we welcome applications from individuals of all backgrounds, identities, and experiences. We do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, skin color, national origin, gender, sexual orientation, age, marital status, disability status, or any other characteristic protected by law. Should you require any accommodations or adjustments throughout the interview process and beyond, please do not hesitate to let us know. We are committed to ensuring that all candidates have an equal opportunity to showcase their abilities and succeed in our organization.

RECRUITMENT PROCESS:

• First interview with the line manager
• Second technical interview with the team
• Final interview with HRD or CEO

CONTRACT INFORMATION:

• Type of contract: Permanent contract
• Starting date: As soon as possible
• Location: Montbonnot (38)

WHAT WE CAN OFFER YOU:

• Competitive salary & performance-based RSU (free shares)
• Additional paid leave (RTT)
• Sustainable mobility incentives
• Generous paternity leave
• Monthly team activities (laser game, hiking, sailing, karaoke …) and large-scale company events