Staff Backend Engineer: Serverless Platform Lead (Remote)

Runware; United States; Remote; USD 180,000 - 260,000; Full time

Benefits offered by this job

Generous paid time off

Meaningful stock options

Remote-first setup

Flexible hours

Family leave

Company retreats

Job summary

Runware in the United States is seeking a Staff/Senior Software Engineer to technically lead and build Runware’s serverless platform. You’ll work with senior leadership to bring a new product line to market and connect the inference engine to a scalable developer experience.

You’ll mentor engineers, design the control plane, and deliver backend systems for GPU-free AI workloads. This remote-first role offers flexible hours and stock options as part of a fast-moving, high-bar environment.

Qualifications

• Strong experience as a Staff Engineer, Senior Software Engineer, Backend Engineer, Platform Engineer or similar.
• Experience building backend services, distributed systems, developer platforms or workload orchestration systems.
• Strong understanding of async processing, queues, scheduling, retries, back pressure and failure handling.
• Comfortable working across APIs, control planes, workers, databases and observability systems.
• Strong engineering fundamentals in one or more backend languages ideally Go.
• Good judgement around trade-offs between reliability, latency, scale and developer experience.
• Clear communication, strong ownership and the ability to lead technical direction in a fast-moving environment.
• Experience building serverless platforms, job execution systems, container platforms or compute orchestration systems.
• Experience with GPU-backed workloads, AI/ML inference, model serving, batch processing or high-performance compute.
• Familiarity with technologies such as vLLM, TensorRT, Triton, Kubernetes, Nomad or Knative.
• Experience improving workload performance through batching, autoscaling, model warm-up, caching, request routing or queue management.
• Experience with multi-tenant isolation, sandboxing, quotas, rate limits, resource accounting or usage-based billing.

Responsibilities

• Build the core systems behind Runware’s serverless platform, including workload execution, routing, scheduling, isolation and scaling leveraging our inference engine.
• Make it simple for developers to deploy models and run AI workloads without managing GPUs, servers, queues or infrastructure through a simple SDK interface.
• Design and improve the control plane for serverless execution, including APIs, workers, lifecycle management, retries and failure handling.
• Work closely with our infrastructure and ML teams to improve workload startup time, GPU utilisation, model warm-up, caching and placement.
• Build observability that makes serverless workloads easy to monitor, debug and operate at scale globally.
• Lead the technical design, mentor other engineers and help define the engineering standards for a new product area.

Skills

Staff Engineer

Backend services

Distributed systems

Async processing

Go

Tools

Kubernetes

Nomad

Knative

TensorRT

Triton

vLLM

Job description

Runware in the United States is seeking a Staff/Senior Software Engineer to technically lead and build Runware’s serverless platform. You’ll work with senior leadership to bring a new product line to market and connect the inference engine to a scalable developer experience.

You’ll mentor engineers, design the control plane, and deliver backend systems for GPU-free AI workloads. This remote-first role offers flexible hours and stock options as part of a fast-moving, high-bar environment.