Senior Backend Engineer, API & Inference Platform

Xai

Greater London

Hybrid

GBP 107,000 - 262,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Equity
Healthcare & dental coverage

Job summary

SpaceXSI is hiring a Senior Backend Engineer to build and operate a scalable inference platform used across Chat API, Imagine API, Voice API, Grok Build, and Grok Bot. The role emphasizes Rust/C++ and distributed systems with a focus on reliability and observability.

You will own platform services, design API features (batch, collections, files), and enforce robust security and data retention policies while supporting a global, follow-the-sun on-call model.

Qualifications

  • 5+ years of experience in designing, implementing, and maintaining reliable and horizontally scalable distributed systems.
  • Experience with Rust or C++.

Responsibilities

  • Build and maintain the unified inference stack as the single surface area for all inference needs across the company
  • Own and evolve the platform services that power Chat API, Imagine API, Voice API, Grok Build, and Grok Bot
  • Design, build, and maintain Chat API features including batch API, collections API, files API, and related capabilities
  • Implement and operate chat moderation and abuse protection systems across the API and grok.com
  • Build and maintain the company-wide logging system for all request types, including enforcement of Zero Data Retention (ZDR) policies
  • Manage multi-region inference cluster (IC) deployments, data aggregation, data replication, and the distributed authentication system
  • Participate in follow-the-sun on-call coverage (UK -> Japan -> US) to ensure continuous reliability of the inference platform

Skills

Rust
C++
Distributed systems
LLM inference engines
Agent SDKs
Docker
Kubernetes
PostgreSQL
Clickhouse
MongoDB
gRPC
TensorRT
vLLM

Tools

Docker
Kubernetes
PostgreSQL
Clickhouse
MongoDB
gRPC
TensorRT
vLLM

Job description

SpaceXSI is hiring a Senior Backend Engineer to build and operate a scalable inference platform used across Chat API, Imagine API, Voice API, Grok Build, and Grok Bot. The role emphasizes Rust/C++ and distributed systems with a focus on reliability and observability.

You will own platform services, design API features (batch, collections, files), and enforce robust security and data retention policies while supporting a global, follow-the-sun on-call model.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Backend Engineer, API — Rust & Scalable Inference
Senior Backend Engineer, API — Rust & Scalable Inference

Maven Ventures • Greater London

On-site
GBP 107,000 - 262,000
Equity
Healthcare
Dental coverage
+4
Backend API Engineer: Scale AI Inference (Rust/C++)
Backend API Engineer: Scale AI Inference (Rust/C++)

SpaceX Super Intelligence • Greater London

On-site
GBP 107,000 - 262,000
Equity
Healthcare
Dental coverage
+2
Backend Engineer: Scalable Rust/C++ API for AI Inference
Backend Engineer: Scalable Rust/C++ API for AI Inference

SpaceXSI • Greater London

On-site
GBP 110,000 - 150,000
Equity
Healthcare and dental coverage
Cash plan
+2
Sr. Backend Engineer, API
Sr. Backend Engineer, API

X.ai • Greater London

On-site
GBP 107,000 - 262,000
Equity
Healthcare
Dental coverage
+4
Sr. Backend Engineer, API
Sr. Backend Engineer, API

Xai • Greater London

Hybrid
GBP 107,000 - 262,000
Equity
Healthcare & dental coverage
Sr. Backend Engineer, API
Sr. Backend Engineer, API

SpaceXSI • Greater London

On-site
GBP 110,000 - 150,000
Equity
Healthcare and dental coverage
Cash plan
+2
Sr. Backend Engineer, API
Sr. Backend Engineer, API

SpaceX Super Intelligence • Greater London

On-site
GBP 107,000 - 262,000
Equity
Healthcare
Dental coverage
+2
Backend Engineer - API
Backend Engineer - API

SpaceXAI • Greater London

On-site
GBP 90,000 - 150,000
Equity
Healthcare and dental coverage
Cash plan
+3
Rust/C++ Backend Engineer for High-Throughput AI API
Rust/C++ Backend Engineer for High-Throughput AI API

SpaceXAI • Greater London

On-site
GBP 90,000 - 150,000
Equity
Healthcare and dental coverage
Cash plan
+3
Senior Backend Engineer — High-Scale Payments & AI Platform
Senior Backend Engineer — High-Scale Payments & AI Platform

Xai • Greater London

On-site
GBP 107,000 - 262,000
Equity
Healthcare
Cash plan
+3