Site Reliability Engineer — AI Inference at Scale

Linuxconfig; San Francisco, Northern (CA, KY); Hybrid; USD 200,000 - 400,000; Full time

Benefits offered by this job

Health benefits

Dental benefits

Vision benefits

401(k) match

Job summary

Inferact is hiring a Site Reliability Engineer to make vLLM-powered inference systems reliable, observable, and operationally simple at production scale.

You will define SLOs, improve monitoring and alerting, strengthen incident response, drive post-mortems, and reduce operational risk before it reaches users. Your work will directly impact reliability and production readiness of AI inference systems.

Qualifications

• Bachelor's degree or equivalent experience in computer science, engineering, systems, infrastructure, or similar.
• Strong experience operating production systems with meaningful traffic, user impact, or infrastructure criticality.
• Deep understanding of SLOs, SLIs, error budgets, alerting, incident response, and post-mortem processes.
• Experience live-fighting major production incidents, including mitigation, root cause analysis, escalation, and follow-through on prevention work.
• Strong Linux, networking, systems debugging, observability, and distributed systems fundamentals.
• Ability to design operationally simple systems and identify likely failure modes before launch.
• Strong programming or scripting ability in Python, Go, Bash, or similar for automation, tooling, and reliability improvements.

Responsibilities

• Define SLOs and SLIs for production systems.
• Improve monitoring, alerting, and incident response processes.
• Drive post-mortems and prevention-oriented engineering work.
• Reduce operational risk before it reaches users and improve system reliability at scale.
• Collaborate with engineering to improve service design, release safety, and capacity planning.

Skills

Linux

Networking

Observability

Distributed systems

Python/Go/Bash

Incident response

Education

Bachelor's degree or equivalent

Tools

Kubernetes

Docker

Terraform

CI/CD

Job description

Inferact is hiring a Site Reliability Engineer to make vLLM-powered inference systems reliable, observable, and operationally simple at production scale.

You will define SLOs, improve monitoring and alerting, strengthen incident response, drive post-mortems, and reduce operational risk before it reaches users. Your work will directly impact reliability and production readiness of AI inference systems.