Senior AI Infrastructure Engineer — Scale Training & Inference

Fin

Greater London

Hybrid

GBP 90,000 - 150,000

Full time

14 days+
Application generator

Turn this role into an interview — a resume and cover letter built around what this employer wants.

Get past ATS filters

Job summary

Fin, now part of Salesforce, is hiring a Senior+ AI Infrastructure Engineer to build training and inference systems for large transformer and LLM models. You will join a small, highly technical team working on GPU‑level performance and scalable pipelines.

You’ll collaborate with ML scientists, own parts of the stack from data ingestion to distributed training and deployment, and contribute to hiring and mentoring. Hybrid London-based role with strong growth in AI infra.

Qualifications

  • 5+ years of experience in software engineering.
  • Degree in Computer Science, Computer Engineering, or equivalent.
  • Hands-on experience with model training and/or model inference at scale.
  • Experience with low‑level GPU work (CUDA or Triton).
  • Production experience in large-scale environments.
  • Strong fundamentals, clear communication, and team collaboration.
  • Proficiency in Python and ability to learn new stacks quickly.

Responsibilities

  • Implement and scale training pipelines for large transformer and LLM models, from data ingestion to distributed training and evaluation.
  • Build and optimize inference services with low latency and high reliability, including autoscaling and routing.
  • Tune GPU kernels, improve utilization, and identify bottlenecks across training and inference stacks.
  • Collaborate with ML scientists to implement advanced training and inference methods and bring them to production.
  • Play an active role in hiring, mentoring, and developing other engineers on the team.
  • Raise the bar for technical standards, reliability, and operational excellence across Fin's AI platform.

Skills

Model training
Model inference
CUDA
Triton
Python
Go
Distributed training

Education

BSc in CS

Tools

Kubernetes
AWS

Job description

Fin, now part of Salesforce, is hiring a Senior+ AI Infrastructure Engineer to build training and inference systems for large transformer and LLM models. You will join a small, highly technical team working on GPU‑level performance and scalable pipelines.

You’ll collaborate with ML scientists, own parts of the stack from data ingestion to distributed training and deployment, and contribute to hiring and mentoring. Hybrid London-based role with strong growth in AI infra.

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

Senior AI Infrastructure Engineer: Training & Inference at Scale
Senior AI Infrastructure Engineer: Training & Inference at Scale

Fin. The highest performing Customer Agent • Greater London

Hybrid
GBP 90,000 - 150,000
Competitive salary and equity
Lunch and snacks every weekday
Pension scheme & match
AI Infrastructure Engineer
AI Infrastructure Engineer

Fin • Greater London

Hybrid
GBP 90,000 - 150,000
Senior ML Systems Engineer - Scalable AI Infra, Hybrid
Senior ML Systems Engineer - Scalable AI Infra, Hybrid

Flawless Holdings • Greater London

Hybrid
GBP 57,000 - 97,000
Hybrid work
Autonomy
Stock options
+1
Senior AI Engineer - Cloud-Native ML & API Microservices
Senior AI Engineer - Cloud-Native ML & API Microservices

Infused Solutions Ltd • Greater London

Hybrid
GBP 65,000 - 75,000
AI Infrastructure Engineer
AI Infrastructure Engineer

Fin. The highest performing Customer Agent • Greater London

Hybrid
GBP 90,000 - 150,000
Competitive salary and equity
Lunch and snacks every weekday
Pension scheme & match
Senior AI Engineer - Cloud-Native ML/NLP Leader
Senior AI Engineer - Cloud-Native ML/NLP Leader

Infused Solutions • Greater London

Hybrid
GBP 65,000 - 75,000
Salary £65,000 – £75,000
Hybrid 1 day per week in London office
Permanent role
+5
Senior AI Infrastructure Architect — Scale & Compute Leadership
Senior AI Infrastructure Architect — Scale & Compute Leadership

Boehringer Ingelheim GmbH • Greater London

Hybrid
GBP 120,000 - 155,000
Hybrid work arrangement
Top Employer UK recognition
Senior AI Systems Engineer for Scalable GenAI Platform
Senior AI Systems Engineer for Scalable GenAI Platform

Nscale • Greater London

On-site
GBP 80,000 - 120,000
ML Platform Engineer - Scale Training & Inference
ML Platform Engineer - Scale Training & Inference

Dex • Greater London

On-site
GBP 180,000 - 300,000
Engineering Manager, Infrastructure London, UK Apply →
Engineering Manager, Infrastructure London, UK Apply →

Scale AI, Inc. • Greater London

On-site
GBP 110,000 - 160,000