Senior LLM Performance & Inference Lead

AMD

Helsinki

On-site

EUR 90,000 - 130,000

Full time

14 days+

Get more replies from employers

Send a job-specific resume in minutes.

Job summary

AMD in Helsinki is seeking an experienced AI performance engineer to optimize production AI services within the AIM ecosystem, focusing on latency, throughput, and deployment configurations across diverse hardware. You will work with state-of-the-art AI tooling, design scalable measurement methodologies, and contribute to tooling that enhances developer and user experience.

A strong background in Python, Bash, Docker, Kubernetes, and Helm is required, with a degree in CS/CE/EE and a passion for

Qualifications

Bachelor’s or Master’s degree in computer science, computer engineering, electrical engineering, or an equivalent field.
Seasoned in deploying LLMs and other AI model types in production using frameworks like vLLM, SGLang, or similar tooling.
Deep knowledge about LLM serving and performance metric evaluation.
Comfortable with Python software development and bash scripting.
Experience with Docker, Kubernetes and Helm.

Responsibilities

Measure, analyze, and optimize LLM and AI service performance across latency and throughput for various training and inference use cases.
Design and develop tooling to measure and analyze the performance of AI model deployments and the effect of different configurations and infrastructure, standalone and Kubernetes clusters.
Develop and maintain internal tooling to support LLM and AI performance tuning at scale.