Senior Inference Platform SRE & Automation Engineer

Devopsroles; Singapore; On-site; SGD 120,000 - 180,000; Full time

Job summary

Bitdeer is seeking an Sr. Inference Service SRE & Automation Engineer to own the reliability of its model endpoints and serving path across multi-cluster deployments.

You will manage API gateway, routing, scheduling, and KV caches, while ensuring 99.95% SLA readiness with robust automation and observability. You will lead GPU fleet health, model load and rollout/rollback, and collaborate with control-plane dependencies to prevent customer impact.

Qualifications

• 5+ years in SRE / productio n platform operations, including 2+ years on a customer-facing API service with SLA targets
• Deep Kubernetes operations experience: HA control plane, multi-cluster topologies, and edge tiers
• Hands-on production experience serving LLM/model inference: vLLM, TensorRT-LLM, batching, KV cache, and latency targets

Responsibilities

• Own end-to-end reliability of inference endpoints and the serving path
• Manage API gateway, inference router, scheduler, queueing, and KV cache
• Oversee GPU fleet health, model load, and rollout/rollback of revisions
• Maintain control plane dependencies: PostgreSQL, Redis, object storage, and secrets
• Define/publish SLOs/SLAs and drive error-budget prioritization
• Build observability with Prometheus/VictoriaMetrics, Grafana, and dashboards

Skills

SRE

Kubernetes

Go

Python

Automation

Terraform

GitOps

Tools

Terraform

Helm

GitOps

ArgoCD/Flux

Docker

Prometheus

VictoriaMetrics

Grafana

Job description

Bitdeer is seeking an Sr. Inference Service SRE & Automation Engineer to own the reliability of its model endpoints and serving path across multi-cluster deployments.

You will manage API gateway, routing, scheduling, and KV caches, while ensuring 99.95% SLA readiness with robust automation and observability. You will lead GPU fleet health, model load and rollout/rollback, and collaborate with control-plane dependencies to prevent customer impact.