Senior ML Systems Engineer - Hardware Acceleration

Arm; Galway; Hybrid; EUR 77,000 - 104,000; Full time

Job summary

Arm is seeking engineers to help shape the future of ML and AI on Arm platforms. You will develop and optimize software that connects ML frameworks to Arm hardware acceleration, collaborating with teams across Arm and partner companies.

The role focuses on hands-on C++, C, and Python work, integrating with llama.cpp, improving performance, and mentoring early-career engineers in a fast-paced, collaborative environment.

Qualifications

• Strong C++, C, and Python programming and software design.
• Experience delivering significant features across multiple teams.
• Familiarity with Git, GitLab, continuous integration, and automated testing.
• Effective technical leadership and communication skills.
• Knowledge of LLM inference, including tokenization, attention, KV caches, batching and quantisation.

Responsibilities

• Develop and optimize C++, C, and Python software that integrates ML platforms with Arm hardware acceleration.
• Design and implement integrations between ML frameworks, runtimes, and hardware-acceleration technologies.
• Analyse and improve performance of ML and LLM workloads.
• Lead significant work from design through delivery, mentoring junior engineers, and supporting technical decisions.

Skills

C++

C

Python

Software design

Multi-team delivery

Git/GitLab

CI/Testing

Technical leadership

LLM inference

Job description

Arm is seeking engineers to help shape the future of ML and AI on Arm platforms. You will develop and optimize software that connects ML frameworks to Arm hardware acceleration, collaborating with teams across Arm and partner companies.

The role focuses on hands-on C++, C, and Python work, integrating with llama.cpp, improving performance, and mentoring early-career engineers in a fast-paced, collaborative environment.