Global GPU Infra SRE for AI Inference

Parasail; United States; Remote; USD 140,000 - 220,000; Full time

Job summary

Parasail is building an enterprise-grade inference cloud for open-weight models. We’re hiring Site Reliability Engineers to own infrastructure across our global GPU fleet, write automation, and improve failure detection and recovery.

You’ll collaborate with infrastructure, platform, and inference engineers in a flat organization to keep services reliable at scale. Ideal candidates have hands-on production experience, strong Linux, Kubernetes, and automation skills, and a pragmatic approach to

Qualifications

• Experience building and operating production infrastructure or distributed systems with ownership of reliability.
• Strong Linux fundamentals and practical knowledge of networking, storage, and containers.
• Hands-on experience running Kubernetes in production.
• Ability to write maintainable software and automation to solve infrastructure problems.
• Systematic debugging across application, cluster, network, and hardware boundaries.
• Good judgment on balancing speed and reliability.
• Initiative to take problems from investigation to implementation with teammates.
• Experience with multi-region, multi-provider, or bare-metal infrastructure.
• Familiarity with GPUs, model serving, or inference systems such as vLLM or SGLang.
• Experience with infrastructure as code, CI/CD, observability, or automated recovery.
• Experience building highly available services, multi-tenant platforms, or distributed data systems.

Responsibilities

• Scale a global GPU fleet.
• Build and improve the Kubernetes infrastructure behind provisioning, networking, storage, and service deployment across providers and regions.
• Make failure survivable by designing better isolation, failover, and recovery.
• Build software that runs infrastructure and automates capacity expansion, deployments, and maintenance.
• Develop observability and diagnostics to reveal bottlenecks and surface failures.
• Own the production feedback loop by responding to incidents and driving root-cause analysis and improvements.
• Push the platform forward to improve performance, utilization, security, and reliability as demand grows.

Skills

Linux fundamentals

Networking

Containers

Kubernetes

Automation

Observability

CI/CD

Distributed systems

Infrastructure operations

Tools

Kubernetes

CI/CD

Job description

Parasail is building an enterprise-grade inference cloud for open-weight models. We’re hiring Site Reliability Engineers to own infrastructure across our global GPU fleet, write automation, and improve failure detection and recovery.

You’ll collaborate with infrastructure, platform, and inference engineers in a flat organization to keep services reliable at scale. Ideal candidates have hands-on production experience, strong Linux, Kubernetes, and automation skills, and a pragmatic approach to