Staff Backend Engineer – Serverless AI Platform Leader

Runware; United States; Remote; USD 180,000 - 240,000; Full time

Benefits offered by this job

Generous paid time off

Meaningful stock options

Remote-first setup

Flexible hours

Family leave

Company retreats

Job summary

Runware is seeking a Staff/Senior Software Engineer to technically lead and build our serverless platform. You will lead a small team and collaborate with senior leadership to bring a new product line to market, connecting our high-performance sonic inference engine with a developer-friendly experience.

You will own backend systems, APIs, scheduling, workload orchestration, and observability, mentoring engineers and shaping engineering standards for a fast-moving, remote-first company that

Qualifications

• Strong experience as a Staff Engineer, Senior Software Engineer, Backend Engineer, Platform Engineer or similar.
• Experience building backend services, distributed systems, developer platforms or workload orchestration systems
• Strong understanding of async processing, queues, scheduling, retries, back pressure and failure handling
• Comfortable working across APIs, control planes, workers, databases and observability systems
• Strong engineering fundamentals in one or more backend languages ideally Go
• Good judgement around trade-offs between reliability, latency, scale, cost and developer experience
• Clear communication, strong ownership and the ability to lead technical direction in a fast-moving environment

Responsibilities

• Build the core systems behind Runware's serverless platform, including workload execution, routing, scheduling, isolation and scaling leveraging our inference engine
• Make it simple for developers to deploy models and run AI workloads without managing GPUs, servers, queues or infrastructure through a simple SDK interface
• Design and improve the control plane for serverless execution, including APIs, workers, lifecycle management, retries and failure handling
• Work closely with our infrastructure and ML teams to improve workload startup time, GPU utilisation, model warm-up, caching and placement
• Build observability that makes serverless workloads easy to monitor, debug and operate at scale globally
• Lead the technical design, mentor other engineers and help define the engineering standards for a new product area

Skills

Staff Engineer

Senior Software Engineer

Backend Engineer

Platform Engineer

Tools

Kubernetes

Knative

Nomad

TensorRT

Triton

vLLM

Job description

Runware is seeking a Staff/Senior Software Engineer to technically lead and build our serverless platform. You will lead a small team and collaborate with senior leadership to bring a new product line to market, connecting our high-performance sonic inference engine with a developer-friendly experience.

You will own backend systems, APIs, scheduling, workload orchestration, and observability, mentoring engineers and shaping engineering standards for a fast-moving, remote-first company that