Senior ML Systems Engineer: Arm Acceleration & LLM

NLP PEOPLE; Galway; On-site; EUR 120,000 - 160,000; Full time

Job summary

Arm in Ireland seeks an experienced software engineer to help shape machine learning on Arm platforms, focusing on integrating ML frameworks with hardware acceleration.

You will work across teams to deliver LLM runtimes, including llama.cpp, and optimize performance for AI workloads on next-generation hardware. This fast-paced role involves mentoring engineers and collaborating on architecture and deployment, with a strong emphasis on DEI and cross-functional teamwork.

Qualifications

• Strong C++, C, and Python programming and software-design skills.
• Experience delivering significant software features across multiple teams.
• Familiarity with Git, GitLab, continuous integration, and automated testing.
• Effective technical leadership and communication skills.
• Knowledge of LLM inference, including tokenization, KV caches, batching and quantisation.

Responsibilities

• Develop and optimize C++, C, and Python software that integrates ML platforms with Arm hardware acceleration.
• Design and implement integrations between ML frameworks, runtimes, and hardware-acceleration technologies.
• Analyse and improve the performance of ML and LLM workloads.
• Lead significant work from design through delivery; mentor junior engineers.

Skills

C++ programming

Python programming

Software design

Git/GitLab CI

Leadership

LLM inference

Hardware acceleration

Performance profiling

Tokenization/quantisation

Tools

llama.cpp

Vulkan

GPU compute

Job description

Arm in Ireland seeks an experienced software engineer to help shape machine learning on Arm platforms, focusing on integrating ML frameworks with hardware acceleration.

You will work across teams to deliver LLM runtimes, including llama.cpp, and optimize performance for AI workloads on next-generation hardware. This fast-paced role involves mentoring engineers and collaborating on architecture and deployment, with a strong emphasis on DEI and cross-functional teamwork.