Senior Cloud Inference Engineer — Multi-Cloud Scale

United States Digital Space LLC; Washington; On-site; USD 291,000 - 485,000; Full time

Job summary

United States Digital Space LLC is seeking a backend engineer to scale Claude across major cloud providers (AWS, GCP, Azure) and to own backend services, ensuring reliability and cost-effectiveness at massive scale. This role requires cross‑functional collaboration with inference, product API, systems, and security teams.

It emphasizes performance, observability, and capacity planning for multi-cloud deployment, delivering safe, high-velocity AI services to developers and enterprises.

Qualifications

• Significant software engineering experience in high-performance, distributed systems serving millions of users.
• Experience building or operating services on AWS, GCP, or Azure, with exposure to Kubernetes and IaC.
• Curious about LLM serving; prior inference or ML experience is not required.
• Able to collaborate cross-functionally with internal and external partners.

Responsibilities

• Design, build, and own backend services and infrastructure that serve Claude across multiple CSPs, accounting for differences in compute hardware, networking, APIs, and operational models
• Work cross-functionally with internal inference, product API, systems, and security teams, among others, and with CSP partners to stand up the full serving stack on new cloud platforms, resolve operational issues, and influence provider roadmaps
• Build and evolve CI/CD automation systems, including validation and deployment pipelines, that reliably ship new model versions to millions of users across cloud platforms without regressions
• Design interfaces and tooling abstractions across CSPs that enable cost-effective inference management, scale across providers, and reduce per-platform complexity
• Contribute to capacity planning, autoscaling, and workload routing strategies that match supply with demand and direct requests to the most cost-effective accelerator and region
• Analyze observability data across providers to identify performance bottlenecks, cost anomalies, and regressions, and drive remediation based on real-world production workloads

Skills

Distributed systems

Cloud platforms

Kubernetes

IaC

LLM serving

Ownership

Education

Bachelor's degree

Tools

Python

Rust

Job description

United States Digital Space LLC is seeking a backend engineer to scale Claude across major cloud providers (AWS, GCP, Azure) and to own backend services, ensuring reliability and cost-effectiveness at massive scale. This role requires cross‑functional collaboration with inference, product API, systems, and security teams.

It emphasizes performance, observability, and capacity planning for multi-cloud deployment, delivering safe, high-velocity AI services to developers and enterprises.