Senior DevOps Engineer — Remote-First AI Inference Infra

Runware; United States; Remote; USD 150,000 - 210,000; Full time

Benefits offered by this job

Generous paid time off

Stock options

Remote-first

Flexible hours

Family leave

Company retreats

Job summary

Runware is seeking a Staff/Senior DevOps Engineer to design, build, and operate the infrastructure powering real-time AI inference across GPU fleets and global production platforms. You will bridge bare-metal, GPUs, networking, automation, and observability to enable fast model launches and low-latency experiences.

This role emphasizes reliability and scale. You will automate provisioning, CI/CD, deployment safety, capacity planning, incident response, and security hardening, while collaborating

Qualifications

• Extensive experience running production systems at scale.
• Strong Linux proficiency and debugging skills.
• Hands-on experience with GPU AI inference workloads.

Responsibilities

• Design, build and operate the infrastructure powering real-time AI inference across GPU fleets and a global production platform.
• Automate provisioning, CI/CD, deployment safety, and capacity planning.
• Improve observability and reliability of high‑performance distributed systems.
• Lead incident response, post‑mortem improvements and security hardening.
• Collaborate with cross‑functional teams to move fast with confidence.

Skills

Linux

CI/CD

IaC

GPU infra

Networking

Observability

Automation

Production systems

Security

Tools

CUDA

Docker

Kubernetes

NVIDIA drivers

Job description

Runware is seeking a Staff/Senior DevOps Engineer to design, build, and operate the infrastructure powering real-time AI inference across GPU fleets and global production platforms. You will bridge bare-metal, GPUs, networking, automation, and observability to enable fast model launches and low-latency experiences.

This role emphasizes reliability and scale. You will automate provisioning, CI/CD, deployment safety, capacity planning, incident response, and security hardening, while collaborating