Staff ML Inference & Framework Integration Engineer

Arm; Galway; Hybrid; EUR 98,000 - 132,000; Full time

Job summary

Arm is looking for engineers to help shape the future of Machine Learning and AI on Arm platforms. You'll connect popular ML frameworks and runtimes to Arm acceleration hardware, enabling efficient generative AI workloads.

You will collaborate with teams across Arm and partners, design integrations, and lead projects from conception to delivery while mentoring junior engineers in a fast-paced environment.

Qualifications

• Strong C++, C, and Python programming and software-design skills.
• Experience delivering significant software features across multiple teams.
• Familiarity with Git, GitLab, continuous integration, and automated testing.
• Effective technical leadership and communication skills.
• Knowledge of LLM inference, including tokenization, attention, KV caches, batching and quantisation.

Responsibilities

• Develop and optimize C++, C, and Python software that integrates ML platforms with Arm hardware acceleration.
• Lead work from design through delivery, mentor engineers, and support technical decisions.

Skills

C++

C

Python

Tools

Git

GitLab

CI

Automated testing

Job description

Arm is looking for engineers to help shape the future of Machine Learning and AI on Arm platforms. You'll connect popular ML frameworks and runtimes to Arm acceleration hardware, enabling efficient generative AI workloads.

You will collaborate with teams across Arm and partners, design integrations, and lead projects from conception to delivery while mentoring junior engineers in a fast-paced environment.