Senior Systems Engineer - AI Inference & Edge Platform

United States Digital Space LLC; United States; Hybrid; USD 180,000 - 240,000; Full time

Job summary

United States Digital Space LLC in Austin, TX is seeking a high‑agency systems engineer to design and operate an AI inference platform across a global GPU‑driven network. You’ll tackle distributed systems challenges, sub‑second cold starts, and multi‑accelerator workloads with AI/ML engineers and hardware partners.

You’ll join a team that values rapid iteration, observability, and mentorship, contributing to a reliable, scalable edge deployment across hundreds of cities.

Qualifications

• Proven experience in systems engineering, with a primary focus on distributed, high‑performance systems.
• Expert proficiency in Rust programming, particularly in an asynchronous environment.
• Deep understanding and hands‑on experience with relevant networking and application protocols (e.g., TCP, HTTP, WebSocket).
• Solid experience with scaling and performance optimization techniques, including load balancing and caching in a distributed environment.

Responsibilities

• Platform Architecture: Develop and maintain core components of the serverless inference platform to ensure high availability and scalability for the company users.
• Optimization & Performance: Optimize the model scheduling system to significantly increase efficiency and resource utilization across our inference infrastructure, and implement improvements to request routing logic to reduce latency for end-users.
• System Reliability: Drive significant, measurable improvements in the platform’s reliability and resilience by identifying and mitigating systemic risks.
• Observability: Expand and refine the observability stack (metrics, logging, tracing) and fine‑tune alerts to proactively identify and resolve production issues.
• Technical Leadership: Lead complex, cross‑functional technical projects from initial concept and design through final deployment and operationalization.
• Mentorship: Act as a mentor to junior engineers and actively contribute to cultivating a strong, collaborative engineering culture within the team.

Skills

Rust

Distributed systems

Networking protocols

Load balancing

Caching

Tools

Kubernetes

Nomad

Job description

United States Digital Space LLC in Austin, TX is seeking a high‑agency systems engineer to design and operate an AI inference platform across a global GPU‑driven network. You’ll tackle distributed systems challenges, sub‑second cold starts, and multi‑accelerator workloads with AI/ML engineers and hardware partners.

You’ll join a team that values rapid iteration, observability, and mentorship, contributing to a reliable, scalable edge deployment across hundreds of cities.