AI Platform Engineer: Scalable Model Serving & Infra

Barlowe LLP

Greater London

On-site

GBP 70,000 - 90,000

Full time

14 days+

Get more replies from employers

Send a job-specific resume in minutes.

Benefits offered by this job

Highly competitive compensation
30 days annual leave
9% company pension contributions
Comprehensive healthcare and life assurance
Lunch provided via Just Eat
Cycle-to-work scheme
Monthly company events

Job summary

Barlowe LLP is seeking a skilled Engineer for its Core AI team based in London. This role involves designing and operating platforms for AI model inference and serving, ensuring secure access to tools and data. The ideal candidate will have strong expertise in C#, Python, and Kubernetes.

Additional perks include competitive compensation, 30 days annual leave, and comprehensive healthcare benefits.

Qualifications

  • Strong expertise in C# and Python, building distributed systems and platform-level software.
  • Deep Kubernetes expertise, including multi-tenant cluster operations and platform extensions.
  • Experience with Docker, Terraform, and CI/CD in controlled or regulated environments.
  • Strong understanding of distributed systems, including networking, storage, security, and performance.
  • Experience with model serving and inference infrastructure, including deployment, scaling, and optimisation of open models.
  • Clear communication skills, with ability to explain complex concepts and produce high-quality technical documentation.

Responsibilities

  • Designing and operating model serving infrastructure, including inference pipelines and scheduling systems.
  • Building and running centralised MCP servers, ensuring secure, reliable access to enterprise tools and data.
  • Owning platform reliability, performance, and scalability across Kubernetes-based infrastructure.
  • Building self-service tooling and APIs to enable teams to provision and consume AI infrastructure independently.
  • Integrating platform services with existing technology stacks, ensuring clear interfaces, monitoring and CI/CD.
  • Evaluating and adopting open-source technologies and applying emerging best practices to improve the platform.

Skills

C#
Python
Kubernetes
Docker
Terraform
CI/CD

Tools

Prometheus
Grafana
OpenTelemetry

Job description

Barlowe LLP is seeking a skilled Engineer for its Core AI team based in London. This role involves designing and operating platforms for AI model inference and serving, ensuring secure access to tools and data. The ideal candidate will have strong expertise in C#, Python, and Kubernetes.

Additional perks include competitive compensation, 30 days annual leave, and comprehensive healthcare benefits.

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

Core AI Platform Engineer - Scalable Infra & Open Models
Core AI Platform Engineer - Scalable Infra & Open Models

G-Research • Greater London

On-site
GBP 120,000 - 180,000
Lunch provided (via Just Eat for Biz)
Dedicated barista bar
30 days annual leave
+2
Senior AI Platform Engineer: Scale Infra & LLM Gateway
Senior AI Platform Engineer: Scale Infra & LLM Gateway

Wave Group • Greater London

Hybrid
GBP 69,000 - 115,000
Private medical
Share schemes
Learning allowance
+1
Platform Engineer: Scalable Analytics & AI Tools
Platform Engineer: Scalable Analytics & AI Tools

Barlowe LLP • Greater London

On-site
GBP 60,000 - 80,000
Competitive compensation plus bonus
Lunch provided
35 days’ annual leave
+3
Core AI Platform Engineer – Inference & Scale
Core AI Platform Engineer – Inference & Scale

G-Research • Greater London

On-site
GBP 110,000 - 140,000
Highly competitive compensation plus annual discretionary bonus
Lunch provided
30 days annual leave
+5
AI Platform Engineer — Build GenAI Infra and Guardrails
AI Platform Engineer — Build GenAI Infra and Guardrails

Barclays • Greater London

On-site
GBP 110,000 - 150,000
AI Platform Engineer – Production-Ready LLM Systems
AI Platform Engineer – Production-Ready LLM Systems

Barlowe LLP • Greater London

On-site
GBP 80,000 - 120,000
Highly competitive compensation
Annual discretionary bonus
35 days annual leave
+4
AI Platform Engineer – LLM Infrastructure
AI Platform Engineer – LLM Infrastructure

Talenzon group • Greater London

On-site
GBP 60,000 - 80,000
Senior LLM Serving Platform Engineer
Senior LLM Serving Platform Engineer

Scale AI • Greater London

On-site
GBP 90,000 - 130,000
AI Infra Engineer for Scalable LLM Serving
AI Infra Engineer for Scalable LLM Serving

Scale AI, Inc. • Greater London

On-site
GBP 110,000 - 160,000
AI Platform Engineer
AI Platform Engineer

Tempest Vane Partners • Greater London

Hybrid
GBP 120,000 - 180,000
Competitive compensation
Discretionary bonus
Benefits package