Site Reliability Engineer — AI Inference (Remote US)

Inferact; United States; Remote; USD 200,000 - 400,000; Full time

Benefits offered by this job

Health benefits

Dental benefits

Vision benefits

401(k) match

Job summary

Inferact is seeking a Site Reliability Engineer to make vLLM-powered inference services dependable in production. You will own reliability from release safety to incident response, define SLOs, build monitoring, and automate operational work to support scalable, efficient inference at scale.

You will drive post‑mortems, remediation actions, and collaborate with engineering on capacity planning and operational readiness to ensure the platform grows without sacrificing reliability.

Qualifications

• Bachelor’s degree or equivalent experience in computer science, engineering, systems, infrastructure, or similar.
• Hands‑on experience building or operating production distributed systems, cloud infrastructure, or services where reliability has meaningful user or business impact.
• Strong programming or scripting ability in Python, Go, Bash, or similar, with experience building tools and automation that solve operational problems.
• Experience responding to significant production incidents, including mitigation, root cause analysis, escalation, and following corrective actions through to completion.
• Practical understanding of service‑level objectives (SLOs), service‑level indicators (SLIs), error budgets, and alerting that distinguishes user‑impacting failures from noise.
• Strong Linux, networking, and systems debugging fundamentals, with the ability to investigate failures across application and infrastructure boundaries.
• Clear communication, sound judgment under pressure, and the ability to work with engineering teams to identify failure modes and make systems simpler to operate.

Responsibilities

• Define SLOs around availability, latency, and successful inference requests.
• Build monitoring that helps engineers pinpoint failures.
• Automate recurring operational work.
• Lead post‑mortems that result in concrete prevention work.
• Partner with engineering on capacity planning and operational readiness so the platform can grow.

Skills

Python Go Bash

Distributed systems

Incident response

SLOs SLIs metrics

Linux networking debugging

Clear communication under pressure

Education

Bachelor’s degree in CS/Engineering or equivalent

Tools

Kubernetes

Docker

Terraform

Linux

Job description

Inferact is seeking a Site Reliability Engineer to make vLLM-powered inference services dependable in production. You will own reliability from release safety to incident response, define SLOs, build monitoring, and automate operational work to support scalable, efficient inference at scale.

You will drive post‑mortems, remediation actions, and collaborate with engineering on capacity planning and operational readiness to ensure the platform grows without sacrificing reliability.