Senior Inference Performance Engineer - Heterogeneous Compute

Callosum

Greater London

On-site

GBP 90,000 - 130,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Equity & Ownership
Private healthcare
Visa sponsorship and relocation
London office—in person work

Job summary

Callosum, based in London, is building a unified, co-evolving AI compute stack. This role focuses on the bridge between internal engineering and real-world performance, ensuring our heterogeneous infrastructure operates under production-like conditions with empirical validation.

You will run experiments, shape deployment patterns, optimize orchestration, and help guide the stack toward robust production readiness through measurable benchmarks and clear feedback to teams across engineering.

Qualifications

  • Experience deploying and benchmarking large model inference in production or production-equivalent environments.
  • Familiarity with multi-node GPU deployments and networking stacks.
  • Strong end-to-end performance characterization: network, runtime, memory, or model bottlenecks.
  • Familiarity with serving frameworks like Dynamo or Triton Inference Server.
  • Clear communication skills to translate performance data into actionable feedback.
  • Disciplined deployment approach: reproducibility and measurement methodology.

Responsibilities

  • Run experiments self-hosting models on cloud or on-prem across providers and hardware configurations, characterising performance envelopes.
  • Develop and maintain deployment patterns that are reproducible and optimised for latency, throughput and cost.
  • Work on orchestration and routing software to improve caching, scheduling, batching, and resource allocation.
  • Act as integration point for accelerator support, engine features, and infrastructure upgrades to provide feedback on bottlenecks and capabilities.
  • Build and maintain benchmarking harnesses, regression suites, and performance dashboards.

Skills

Production inference in production
Multi-node GPU deployments
Performance characterization
Serving frameworks like Dynamo
Clear communication
Deployment discipline

Tools

Dynamo
Triton Inference Server

Job description

Callosum, based in London, is building a unified, co-evolving AI compute stack. This role focuses on the bridge between internal engineering and real-world performance, ensuring our heterogeneous infrastructure operates under production-like conditions with empirical validation.

You will run experiments, shape deployment patterns, optimize orchestration, and help guide the stack toward robust production readiness through measurable benchmarks and clear feedback to teams across engineering.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Systems Simulation & Performance Engineer
Senior Systems Simulation & Performance Engineer

Callosum • Greater London

On-site
GBP 90,000 - 170,000
Competitive salary
Equity & Ownership
Private healthcare
+2
Senior AI Infrastructure Simulation Scientist
Senior AI Infrastructure Simulation Scientist

Abundant Code • Greater London

On-site
GBP 90,000 - 130,000
Competitive salary
Equity & Ownership
Private healthcare
+1
Hardware-Aware AI Model Optimisation Engineer
Hardware-Aware AI Model Optimisation Engineer

Callosum Technologies Ltd. • Greater London

On-site
GBP 120,000 - 170,000
Equity & Ownership
Private healthcare
Visa sponsorship and relocation
+1
Staff Systems Simulation & Performance Engineer
Staff Systems Simulation & Performance Engineer

Callosum Technologies Ltd. • Greater London

On-site
GBP 80,000 - 120,000
Competitive Salary
Equity & Ownership
Private healthcare
+1
Heterogeneous Interconnects Architect for AI Systems
Heterogeneous Interconnects Architect for AI Systems

AI Startups UK • Greater London

Hybrid
GBP 90,000 - 150,000
Equity
Private healthcare
Visa sponsorship
+1
Senior Interconnects Engineer, Heterogeneous AI Systems
Senior Interconnects Engineer, Heterogeneous AI Systems

Callosum Technologies Ltd. • Greater London

Hybrid
GBP 120,000 - 180,000
Competitive salary
Equity & ownership
Private healthcare
+2
Inference Performance & Deployment - Member of Technical Staff
Inference Performance & Deployment - Member of Technical Staff

Callosum • Greater London

On-site
GBP 90,000 - 130,000
Equity & Ownership
Private healthcare
Visa sponsorship and relocation
+1
Systems Simulation & Performance Modelling - Member of Technical Staff
Systems Simulation & Performance Modelling - Member of Technical Staff

Callosum • Greater London

On-site
GBP 90,000 - 170,000
Competitive salary
Equity & Ownership
Private healthcare
+2
Systems Simulation & Performance Modelling - Member of Technical Staff
Systems Simulation & Performance Modelling - Member of Technical Staff

Callosum Technologies Ltd. • Greater London

On-site
GBP 80,000 - 120,000
Competitive Salary
Equity & Ownership
Private healthcare
+1
Compute Efficiency Staff Engineer - Hybrid, London
Compute Efficiency Staff Engineer - Hybrid, London

Isomorphic Labs • Greater London

Hybrid
GBP 120,000 - 180,000