Senior AI Inference Reliability Engineer

Parasail; San Mateo; On-site; PHP 2,000,000 - 3,000,000; Full time

Job summary

Parasail is redefining AI infrastructure by enabling seamless deployment across a distributed network of GPUs, optimizing for cost, performance, and flexibility. Our mission is to empower AI developers with a fast, cost-efficient, and scalable cloud experience—free from vendor lock-in and designed for the next generation of AI workloads.

The Senior/Staff Inference Reliability Engineer will own the end-to-end reliability and production performance of customer inference workloads.

Qualifications

• 5+ years of experience in production engineering, site reliability engineering, infrastructure engineering, distributed systems, ML infrastructure, database reliability, or performance engineering.
• Demonstrated ownership of a critical production service or workload.
• Experience diagnosing complex latency, throughput, capacity, or reliability problems across multiple system layers.
• Strong software-engineering ability beyond infrastructure configuration and CI/CD automation.
• Hands‑on experience building observability, automation, diagnostic tooling, or production safeguards.
• Strong communication and technical leadership skills, including the ability to coordinate incident resolution across engineering teams.

Responsibilities

• Own the production health of customer inference workloads, including availability, request success, time to first token, inter-token latency, throughput, and operational efficiency.
• Establish clear service-level indicators, objectives, performance baselines, and escalation paths for production endpoints.
• Build the telemetry, dashboards, alerts, and automated diagnostics needed to detect meaningful endpoint degradation before customers report it.
• Lead the investigation of complex latency, throughput, capacity, and reliability regressions.
• Determine whether an issue originates in customer traffic patterns, platform services, inference-engine configuration, GPU hardware, networking, storage, or an external infrastructure provider.
• Remain accountable for the customer outcome while partnering with the appropriate engineering teams to implement the fix.
• Help lead customer-impacting incidents and establish effective operational practices for acknowledgement, diagnosis, recovery, and communication.

Skills

Production Systems

Reliability Engineering

Performance Diagnosis

Distributed Systems

Cloud & Infrastructure

Software Engineering

AI/Inference Systems

Tools

Kubernetes

Linux

Cloud providers

Job description

Parasail is redefining AI infrastructure by enabling seamless deployment across a distributed network of GPUs, optimizing for cost, performance, and flexibility. Our mission is to empower AI developers with a fast, cost-efficient, and scalable cloud experience—free from vendor lock-in and designed for the next generation of AI workloads.

The Senior/Staff Inference Reliability Engineer will own the end-to-end reliability and production performance of customer inference workloads.