AI Inference Engineer — Brain-Inspired, Efficient Models

IC Resources

Greater London

On-site

GBP 80,000 - 120,000

Full time

14 days+

Get a reply from this recruiter

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Intellectual Capital Resources Ltd in London seeks a Research Scientist/Research Engineer focused on accelerating inference for brain-inspired AI.

You will profile costs, implement quantisation, sparsity, pruning, and distillation, and optimize KV caching, decoding, batching, and attention for various backends.

You’ll work with CUDA/Triton, vLLM/TensorRT-LLM and llama.cpp on GPU/CPU accelerators, and contribute to rigorous experiments and potential publications.

Qualifications

  • Bachelor’s/Master’s/PhD in a quantitative field as listed.
  • Strong understanding of modern DL and LLM architectures and their run costs.
  • Strong Python and PyTorch/JAX experience with hands-on profiling on GPUs/CPUs.
  • Foundations in linear algebra, probability, optimisation, numerical methods or information theory.
  • Rigorous experimental mindset spanning theory, experiment and implementation.
  • Publications or open-source contributions valued; industry experience not essential.

Responsibilities

  • Perform inference profiling and cost modelling (compute, memory, latency, energy).
  • Develop efficient inference methods: quantisation, sparsity, pruning, distillation, compression.
  • Optimize inference: KV cache management, speculative decoding, batching, efficient attention.
  • Engage in GPU programming and performance engineering (CUDA, kernels, profiling).
  • Explore non-Transformer and brain-inspired architectures and HW-aware ML.
  • Collaborate across research and engineering teams to advance core tech.

Skills

Python
PyTorch
JAX
CUDA
Triton
Profiling
Optimization
Deep learning
LLM architectures
Optimization theory

Education

Bachelor’s, Master’s or PhD in Maths, CS, Physics, Engineering, Neuroscience or related quantitative field

Tools

vLLM
TensorRT-LLM
llama.cpp
CUDA tooling / Profiling tools

Job description

Intellectual Capital Resources Ltd in London seeks a Research Scientist/Research Engineer focused on accelerating inference for brain-inspired AI.

You will profile costs, implement quantisation, sparsity, pruning, and distillation, and optimize KV caching, decoding, batching, and attention for various backends.

You’ll work with CUDA/Triton, vLLM/TensorRT-LLM and llama.cpp on GPU/CPU accelerators, and contribute to rigorous experiments and potential publications.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

AI Inference Engineer
AI Inference Engineer

IC Resources • Greater London

On-site
GBP 80,000 - 120,000
Brain-Inspired AI Research Engineer
Brain-Inspired AI Research Engineer

IC Resources • Greater London

On-site
GBP 65,000 - 120,000
Ai Software Engineer
Ai Software Engineer

IC Resources • Greater London

On-site
GBP 70,000 - 120,000
AI Systems Engineer: Scaling Models & Efficient Inference
AI Systems Engineer: Scaling Models & Efficient Inference

IC Resources • Greater London

On-site
GBP 70,000 - 120,000
AI Research Engineer
AI Research Engineer

IC Resources • Greater London

On-site
GBP 65,000 - 120,000
LLM Architectures Research Scientist — Efficient Inference
LLM Architectures Research Scientist — Efficient Inference

CommonAI C.I.C. • Cambridge

On-site
GBP 90,000 - 130,000
Top-tier Claude Code subscription
Cambridge office near train station
Competitive salary package and pension
+1
AI Software Engineer
AI Software Engineer

IC Resources • Greater London

On-site
GBP 80,000 - 140,000
AI Inference Optimizations Engineer (MLIR/LLVM)
AI Inference Optimizations Engineer (MLIR/LLVM)

microTECH Global Limited • City of Edinburgh

Hybrid
GBP 90,000 - 120,000
Senior FPGA Engineer – AI Inference Accelerator
Senior FPGA Engineer – AI Inference Accelerator

Intellectual Capital Resources Ltd • Greater London

On-site
GBP 95,000 - 130,000
AI Inference Engineer — GPU-Optimized Rust/Python (Equity)
AI Inference Engineer — GPU-Optimized Rust/Python (Equity)

CVFine by Instrovate Technologies • Greater London

On-site
GBP 70,000 - 90,000