Rust Backend Engineer for Scalable AI API

SpaceXAI; United States; On-site; USD 150,000 - 210,000; Full time

Benefits offered by this job

Equity

Healthcare coverage

Dental coverage

Job summary

SpaceXAI is seeking a backend-focused engineer to help build scalable production infrastructure for our AI models. Our stack emphasizes Rust/C++, distributed systems, and high-throughput inference with low latency.

You will own API development, model serving, routing, SDKs, and observability, collaborating across a small, hands-on team to deliver reliable, scalable services. Familiarity with Docker, Kubernetes, and gRPC is a strong plus.

Qualifications

• Expert knowledge of either Rust or C++.
• Experience in designing, implementing, and maintaining reliable and horizontally scalable distributed systems.
• Knowledge of service observability and reliability best practices.

Responsibilities

• Build the SpaceXAI API that serves our models to developers worldwide.
• Own end-to-end inference system with high throughput, low latency, and high availability, including model serving, routing, SDKs, rate limiting, observability, and scaling.

Skills

Rust

C++

Distributed systems

Observability

Reliability

LLM inference

Agent SDKs

Tools

PostgreSQL

Clickhouse

MongoDB

Docker

Kubernetes

gRPC

TensorRT

SGLang

vLLM

Job description

SpaceXAI is seeking a backend-focused engineer to help build scalable production infrastructure for our AI models. Our stack emphasizes Rust/C++, distributed systems, and high-throughput inference with low latency.

You will own API development, model serving, routing, SDKs, and observability, collaborating across a small, hands-on team to deliver reliable, scalable services. Familiarity with Docker, Kubernetes, and gRPC is a strong plus.