Senior GPU Compute Fleet Engineer | Remote-First

Boundless Networks; United States; Remote; USD 175,000 - 250,000; Full time

Benefits offered by this job

Equity

Health, dental, vision

Flexible PTO

Professional development budget

Remote-first with off-sites

Job summary

Boundless is building a global GPU compute fabric to power AI inference workloads. As a Senior Infrastructure Engineer (GPU Compute), you will orchestrate a heterogeneous fleet (consumer to datacenter GPUs, including RTX 5090) across regions and providers, pushing performance and cost efficiency.

You’ll own scheduling, bare-metal optimization, and secure, observable access with a bias for action in a high-autonomy role.

Qualifications

• 5+ years of infrastructure/DevOps experience operating large-scale production systems.
• Deep expertise in Kubernetes, Docker, and container orchestration at scale.
• Strong Linux systems administration skills.
• Proficiency in infrastructure-as-code tools (Terraform, Ansible, Pulumi).
• Track record of managing mission-critical, high-throughput systems.
• Strong IaC background in heterogeneous environments.
• Proficiency in at least one scripting or programming language (Python, Bash, Go, etc.).
• Comfort navigating ambiguity with a strong bias for action.

Responsibilities

• GPU Fleet Orchestration: Operate a heterogeneous, multi-region GPU fleet using SkyPilot, Kubernetes/k3s, and cloud+on-prem providers.
• Compute Scheduling & Utilization: Maximize GPU utilization across inference workloads with smart workload placement.
• Bare-Metal & GPU Optimization: Optimize PCIe, ReBAR, NUMA, CUDA tuning, memory, and network topology for throughput per node.
• Reliability, Access & Observability: Build secure fleet access and robust observability across distributed nodes.
• Cost Optimization: Reduce $/GPU-hr via spot instances, on-prem/cloud strategy, and resource scheduling while maintaining reliability.

Skills

Kubernetes

Docker

Linux

Python

Bash

Go/TypeScript

Tools

Terraform

Ansible

Pulumi

SkyPilot

K3s

Prometheus/Grafana

Job description

Boundless is building a global GPU compute fabric to power AI inference workloads. As a Senior Infrastructure Engineer (GPU Compute), you will orchestrate a heterogeneous fleet (consumer to datacenter GPUs, including RTX 5090) across regions and providers, pushing performance and cost efficiency.

You’ll own scheduling, bare-metal optimization, and secure, observable access with a bias for action in a high-autonomy role.