AI Inference Engineer - High-Performance GPU Rust | Equity

Fdetimes; Greater London; Hybrid; GBP 90,000 - 140,000; Full time

Job summary

Fdetimes is seeking an AI Inference Engineer to join our growing team in the UK. You will optimize and scale our inference engine for latency and cost budgets, spanning CUDA kernels, Rust serving runtime, and Python model code.

You should have hands-on experience with GPU programming, production distributed systems, and familiarity with at least one deep learning framework. The role offers challenging projects and strong growth opportunities.

Qualifications

• 3+ years of professional software engineering experience with ML inference or high-performance systems.
• Familiarity with at least one deep learning framework (PyTorch, JAX, TensorFlow).
• Understanding of GPU architectures (memory hierarchy, warp scheduling, tensor cores).
• Understanding of common LLM architectures and inference optimization techniques (e.g. quantization, speculative decoding, prefill-decode disaggregation).

Responsibilities

• New models support. Support transformer-based retrieval, text-generation, and multimodal models in our inference infrastructure, from weight loading, request scheduling and KV-cache management to support in API Gateway.
• GPU kernels migration to CuTe DSL. Port our in-house CUDA kernels to NVIDIA's CuTe DSL so they run on GB200 today and are portable to Vera Rubin racks tomorrow.
• Rust-native serving runtime. Develop our internal Rust-based inference server to solve all Python pains and keep up with rapidly growing traffic.
• Performance optimisation. Profile and fix bottlenecks from network ingress through continuous batching and GPU kernels interleaving.
• Reliability and observability. Build dashboards, alerts, and automated remediation so we catch regressions before users do. Respond to and learn from production incidents.

Skills

CUDA

Python

Rust

GPU programming

Tools

CuTe DSL

CUDA

TensorRT

Job description

Fdetimes is seeking an AI Inference Engineer to join our growing team in the UK. You will optimize and scale our inference engine for latency and cost budgets, spanning CUDA kernels, Rust serving runtime, and Python model code.

You should have hands-on experience with GPU programming, production distributed systems, and familiarity with at least one deep learning framework. The role offers challenging projects and strong growth opportunities.