Senior AI Platform Engineer: Scalable Inference & Kubernetes

Leonardo; City of Edinburgh; Hybrid; GBP 80,000 - 130,000; Full time

Benefits offered by this job

Time to Recharge

Pension scheme

Mental health support

Bonus scheme

Courses via Coursera/LinkedIn Learning

Referral programme

Private healthcare & flex benefits

Job summary

Leonardo in Edinburgh is seeking a Senior or Principal AI Platform Engineer to shape, build and operate the infrastructure underpinning our AI platform, enabling engineers to access models and inference services securely and reliably.

You will own the platform layer above GPU infrastructure, deploy scalable inference services using Docker, Kubernetes and vLLM, and drive observability, security and performance in a hybrid environment.

Qualifications

• Experience operating shared or business-critical platforms.
• Familiarity with large language models and running them.
• Experience troubleshooting distributed systems and performance issues.
• Familiarity with infrastructure as code and CI/CD.
• Effective communication and stakeholder engagement.
• Curiosity and a drive for continuous improvement.

Responsibilities

• Own the platform layer above GPU infrastructure, including model serving, inference runtimes, AI gateways and supporting services.
• Deploy and operate scalable inference services with containers, Kubernetes, vLLM; improve observability and performance.

Skills

Platform ownership

Distributed systems

Communication

Curiosity

Security-aware design

Tools

Docker

Kubernetes

vLLM

LiteLLM

Bifrost

Python

Bash

Go

Job description

Leonardo in Edinburgh is seeking a Senior or Principal AI Platform Engineer to shape, build and operate the infrastructure underpinning our AI platform, enabling engineers to access models and inference services securely and reliably.

You will own the platform layer above GPU infrastructure, deploy scalable inference services using Docker, Kubernetes and vLLM, and drive observability, security and performance in a hybrid environment.