Staff AI Infra & DevOps Engineer - Remote & Flexible

Runware Inc.

United Kingdom

Remote

GBP 70,000 - 100,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Generous paid time off
Meaningful stock options
Remote-first setup
Flexible hours
Family leave
Company retreats

Job summary

Runware Inc. is seeking a Staff/Senior DevOps Engineer to design and operate systems that power real-time AI inference. This role emphasizes building scalable infrastructure using high-performance distributed systems, with a strong focus on automation, security, and operational excellence. The ideal candidate will have significant experience managing production systems, solid Linux knowledge, and expertise in networking. Benefits include generous paid time off, stock options, and flexible working hours, as well as remote work flexibility.

Qualifications

  • Strong experience as a DevOps Engineer or similar role with a track record of running production systems at scale.
  • Deep Linux knowledge and confidence debugging production issues.
  • Hands-on experience with automation and Infrastructure-as-Code.

Responsibilities

  • Build and scale the infrastructure that powers real-time AI inference.
  • Automate infrastructure operations and enhance CI/CD processes.
  • Strengthen security and compliance foundations of infrastructure.

Skills

DevOps Engineering
Linux
Automation
Networking
Security
High Availability Systems

Tools

Git
Docker
Kubernetes

Job description

Runware is building the API layer for the next generation of AI products. Our platform gives teams fast, reliable access to real-time inference across thousands of models through a single flexible API. We help customers build and scale media generation products with better performance, lower cost, and less operational complexity.

Behind this is an infrastructure platform built for speed, reliability, and GPU scale. New models launch constantly. Customer traffic can grow quickly. Performance matters at every layer.

We are looking for a Staff/Senior DevOps Engineer to help build, operate, and scale the infrastructure behind Runware’s global AI inference platform. You’ll play a critical role in making our systems faster, more resilient, easier to operate, and ready for the next stage of growth.

About the role

Runware’s infrastructure is the engine behind some of the fastest-growing AI products in the world. As a Staff/Senior DevOps Engineer, you’ll help design, build, and operate the systems that power real-time AI inference across large-scale GPU fleets and a global production platform.

This is not a traditional DevOps role. You’ll be working at the intersection of bare-metal infrastructure, GPUs, networking, automation, observability, and high-performance distributed systems. Your work will directly shape how quickly we can launch new models, scale customer traffic, recover from failures, and deliver low-latency AI experiences to millions of users.

You’ll turn complex, hardware-driven infrastructure into reliable, automated, developer-friendly platforms. From provisioning and orchestration to deployment pipelines, monitoring, incident response, and capacity scaling, you’ll help remove friction so engineering teams can move faster without compromising reliability.

You’ll build the foundations that let Runware scale with confidence: infrastructure that is fast, resilient, observable, secure, and built for the demands of real-time AI.

What you’ll do
  • Build and scale the infrastructure that powers real-time AI inference across GPU fleets, bare-metal servers, serverless and containerised production systems
  • Help evolve Runware’s platform toward more elastic, on-demand infrastructure that can scale quickly with customer traffic and model demand
  • Make Runware faster, more reliable and more resilient by improving the critical paths behind our request entrypoints, inference services, queues, storage, load balancers and networking layer
  • Automate the hard parts of infrastructure operations, from provisioning and configuration through to CI/CD, deployment safety, progressive rollouts and rapid rollback
  • Build the observability backbone for a high-performance AI platform, with the signals needed to spot issues early, understand capacity and fix problems before customers feel them
  • Play a leading role in production operations, incident response, debugging and post-incident improvements, helping us turn operational challenges into a stronger platform
  • Strengthen the security and compliance foundations of our infrastructure through patching, secrets management, access controls, hardening, auditability, documentation and repeatable operational processes
  • Strong experience as a DevOps Engineer, SRE, Infrastructure Engineer, Platform Engineer or similar, with a track record of running production systems at scale
  • Deep Linux knowledge and confidence debugging real production issues across networking, storage, performance, services and system behaviour
  • Hands-on experience building automation, Infrastructure-as-Code, CI/CD pipelines and deployment workflows that make infrastructure safer and easier to operate
  • Experience operating high-availability, low-latency or high-throughput platforms where reliability and performance directly affect customers
  • Strong networking fundamentals across TCP/IP, DNS, load balancing, routing, firewalls, proxies, TLS and HTTP
  • A calm and pragmatic approach under pressure, with strong communication, good judgement and a bias toward automation over manual toil
Bonus
  • Experience operating GPU infrastructure for AI/ML inference, including NVIDIA drivers, CUDA, container runtimes, GPU monitoring, capacity planning and workload isolation
  • Familiarity with inference serving and optimisation frameworks such as vLLM, TensorRT, Triton or similar

We’re a remote-first collective, meeting in person twice a year to plan, brainstorm, celebrate wins, and enjoy some face-to-face time. We have core hours for cooperative working and calls, but outside of that your calendar is yours. Work the hours that let you perform at your peak while also building a healthy life.

We move quickly and hold a high bar, but we also believe sustainable performance matters. After major releases and milestones, we create space for the team to properly unplug, recharge and come back with the energy to tackle what's next.

  • Generous paid time off– vacation, sick days, public holidays
  • Meaningful stock options– share in the upside you create
  • Remote-first setup– work from home anywhere we can employ you
  • Flexible hours– own your schedule outside core collaboration blocks
  • Family leave– paid maternity, paternity, and caregiver time
  • Company retreats– twice-yearly gatherings in inspiring locations
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Staff Software Engineer - Serverless
Staff Software Engineer - Serverless

Speedrun Talent Network • United Kingdom

Remote
GBP 90,000 - 130,000
Generous paid time off
Meaningful stock options
Remote-first setup
+3
Staff Serverless Platform Engineer – Remote & Flexible
Staff Serverless Platform Engineer – Remote & Flexible

Runware • United Kingdom

Remote
GBP 70,000 - 90,000
Generous paid time off
Meaningful stock options
Flexible hours
+2
Senior Product Manager - Serverless & Compute Leader
Senior Product Manager - Serverless & Compute Leader

Runware • Greater London

Remote
GBP 90,000 - 130,000
Generous stock options
Flexible hours
Family leave
Senior Product Manager - Serverless & Compute
Senior Product Manager - Serverless & Compute

Runware • Greater London

Remote
GBP 90,000 - 130,000
Generous stock options
Flexible hours
Family leave
Senior ML Engineer — Remote-First, Flexible Hours
Senior ML Engineer — Remote-First, Flexible Hours

Runware • United Kingdom

Remote
GBP 90,000 - 140,000
Generous paid time off
Meaningful stock options
Remote-first setup
+3
Senior Machine Learning Engineer
Senior Machine Learning Engineer

Runware • United Kingdom

Remote
GBP 90,000 - 140,000
Generous paid time off
Meaningful stock options
Remote-first setup
+3
Product Lead - Serverless & Compute
Product Lead - Serverless & Compute

Speedrun Talent Network • Greater London

Hybrid
GBP 100,000 - 170,000
Generous paid time off
Stock options
Flexible hours
+2
Product Lead - Serverless & Compute
Product Lead - Serverless & Compute

Runware • Greater London

Remote
GBP 90,000 - 150,000
Generous paid time off
Meaningful stock options
Flexible hours
+2
Senior Security Engineer
Senior Security Engineer

Runware • United Kingdom

Remote
GBP 90,000 - 130,000
Stock options
Remote-first
Company retreats
+2
Senior Web API & DevEx Engineer — Remote & Flexible Hours
Senior Web API & DevEx Engineer — Remote & Flexible Hours

Runware • United Kingdom

Remote
GBP 70,000 - 110,000
Generous paid time off
Meaningful stock options
Remote-first setup
+3