Sr GPU Cloud K8S Expert (SRE SME)

Bitdeer (NASDAQ: BTDR)

San Jose (CA)

On-site

USD 180,000 - 300,000

Full time

5 days ago
Be an early applicant
Application generator

Stand out for this role — generate a tailored resume and cover letter in about a minute.

Get past ATS filters

Job summary

Bitdeer is building an AI-operated GPU cloud. You will design, deploy, and operate the Kubernetes-based control plane that enables topology-aware scheduling, self-healing, and automated remediation for GPU workloads.

In year one you will optimize multi-tenant clusters, implement BMaaS provisioning, and integrate Prometheus/Grafana monitoring. You will work with Go/Python to develop operators and CRDs that drive autonomous workflows.

Qualifications

  • 5+ years in Kubernetes operations with hands-on GPU workload management
  • Deep expertise with Nvidia GPU operator, device plugin, and GPU scheduling in K8S
  • Experience with topology-aware scheduling and GPU resource management
  • Hands-on experience building multi-tenant K8S platforms with strong isolation
  • Experience with bare-metal provisioning and lifecycle automation
  • Proficiency in Terraform, Helm, and GitOps workflows (ArgoCD/Flux)
  • Strong SRE background: SLI/SLO, incident management, capacity planning
  • Experience with Prometheus, Grafana, and alerting at scale
  • Programming skills in Go or Python for operator/CRD development
  • AIOps mindset: automate remediation as part of the control plane
  • Runbook-as-code mindset for executable playbooks

Responsibilities

  • Production Kubernetes clusters optimized for GPU workloads (100-10,000 GPUs)
  • Nvidia GPU operator, device plugin, MIG configuration, and GPU time-slicing policies
  • Topology-aware scheduling: GPU locality, NVLink awareness, network affinity
  • CRDs for GPU workload lifecycle management
  • AI framework integrations: Slurm on K8S, Ray on K8S, Kubeflow
  • Multi-tenant isolation: namespaces, network policies, resource quotas, RBAC, pod security
  • BMaaS provisioning: automated onboarding, lifecycle, reclamation
  • Terraform providers and modules for infrastructure-as-code across GPU clusters
  • SLIs/SLOs for cluster availability and provisioning latency
  • Incident management: runbook automation, escalation, post-incident reviews
  • Monitoring: Prometheus, Grafana, Alertmanager
  • GPU node failure handling: automated drain/cordon/taint and reschedule

Skills

Kubernetes operations
GPU workloads on K8S
Topology-aware scheduling
Multi-tenant platforms
Go or Python

Tools

Terraform
Helm
GitOps
Prometheus
Grafana

Job description

Bitdeer is a world-leading technology company for AI and Bitcoin mining infrastructure.

Bitdeer is committed to providing comprehensive Bitcoin mining solutions for its customers and building AI computational infrastructure to support the AI revolution. Bitdeer handles complex processes involved in computing such as equipment procurement, transport logistics, data center design and construction, equipment management, and daily operations. Bitdeer also offers advanced cloud capabilities to customers with high demand for artificial intelligence.

Headquartered in Singapore, Bitdeer has deployed data centers across multiple countries, including the United States, Norway, Bhutan, and Ethiopia.

To learn more, visit https://ir.bitdeer.com/

Position Overview

You run the control plane where AIOps meets tenants - where topology-aware scheduling, self-healing, and agent-driven remediation actually execute.

NeoCloud is building an AI-operated GPU cloud. Kubernetes is where all of that lands on real customer workloads: the topology-aware scheduler places jobs on the right NVLink domain, the operator drains and reschedules around predicted faults, and the tenant boundary is enforced against a Bare-Metal-as-a-Service backend. In this role you design, deploy, and operate that control plane - and you make sure the AIOps substrate can reach in and remediate without a human on the pager.

What You'll Own
  • Production Kubernetes clusters optimized for GPU workloads at scale (100-10,000 GPUs).
  • Nvidia GPU operator, device plugin, MIG configuration, and GPU time-slicing policies.
  • Topology-aware scheduling: GPU locality, NVLink domain awareness, network rail affinity.
  • Custom Resource Definitions (CRDs) for GPU workload lifecycle management.
  • AI framework integrations: Slurm on K8S, Ray on K8S, Kubeflow.
  • Multi-tenant isolation: namespaces, network policies, resource quotas, RBAC, pod security standards.
  • Bare-Metal as a Service (BMaaS): automated provisioning, tenant onboarding, lifecycle, reclamation.
  • Terraform providers and modules for infrastructure-as-code across GPU clusters.
  • SLIs/SLOs for cluster availability, job completion rates, and provisioning latency.
  • Incident management: runbook automation, escalation, post-incident reviews.
  • Monitoring stack: Prometheus, Grafana, Alertmanager, PagerDuty.
  • GPU node failure handling: automated detection, drain/cordon/taint, workload rescheduling.
Feed the AIOps substrate
  • The remediation-actuator and workflow engine land here - you make the control plane safe for automated action.
  • Your CRDs are the schema the platform's predictors and remediators write against.
  • Every human intervention you do this quarter becomes an autonomous workflow next quarter.
What Success Looks Like In Year 1
  • Automated drain/reschedule around predicted GPU faults, at scale, without customer impact.
  • BMaaS live for external tenants with self-service onboarding.
  • Cluster availability and job-completion SLOs published and met.
Job Requirement
  • 5+ years in Kubernetes operations, with at least 2 years managing GPU workloads on K8S
  • Deep understanding of Nvidia GPU operator, device plugin, and GPU scheduling in K8S
  • Experience with topology-aware scheduling and GPU-specific resource management
  • Hands-on experience building multi-tenant K8S platforms with strong isolation guarantees
  • Experience with bare-metal server provisioning and lifecycle automation (Ironic, MAAS, or custom)
  • Proficiency in Terraform, Helm, and GitOps workflows (ArgoCD/Flux)
  • Strong SRE background: SLI/SLO frameworks, incident management, capacity planning
  • Experience with Prometheus, Grafana, and alerting at scale
  • Strong programming skills in Go or Python for operator/CRD development
  • AIOps aptitude - you think of the K8S control plane as an execution surface for automated remediation, not just a scheduler. You've either wired an autoscaler/remediator loop into K8S or you can design one.
  • Runbook-as-code mindset - every SRE playbook you write should be executable by the platform.

Bitdeer is committed to providing equal employment opportunities in accordance with country, state, and local laws. Bitdeer does not discriminate against employees or applicants based on conditions such as race, color, gender identity and/or expression, sexual orientation, marital and/or parental status, religion, political opinion, nationality, ethnic background or social origin, social status, disability, age, indigenous status, and union.

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

Sr GPU Cloud K8S Expert (SRE SME)
Sr GPU Cloud K8S Expert (SRE SME)

Bitdeer • San Jose (CA)

On-site
USD 180,000 - 230,000
Sr GPU Cloud K8S Expert (SRE SME)
Sr GPU Cloud K8S Expert (SRE SME)

Bitdeer Technologies Group • San Jose (CA)

On-site
USD 180,000 - 240,000
K8 Site Reliability SME
K8 Site Reliability SME

Bitdeer (NASDAQ: BTDR) • Austin (TX)

On-site
USD 180,000 - 240,000
Sr SRE & Automation Engineer (Customer Facing)
Sr SRE & Automation Engineer (Customer Facing)

Bitdeer (NASDAQ: BTDR) • San Jose (CA)

On-site
USD 180,000 - 240,000
Sr SRE & Automation Engineer (Customer Facing)
Sr SRE & Automation Engineer (Customer Facing)

Bitdeer (NASDAQ: BTDR) • Austin (TX)

On-site
USD 140,000 - 180,000
Sr SRE & Automation Engineer (Customer Facing)
Sr SRE & Automation Engineer (Customer Facing)

Bitdeer • San Jose (CA)

On-site
USD 180,000 - 260,000
Sr SRE & Automation Engineer (Customer Facing)
Sr SRE & Automation Engineer (Customer Facing)

Bitdeer Technologies Group • Austin (TX)

On-site
USD 150,000 - 230,000
Sr. GPU Cloud Storage Solutions Expert (SRE SME)
Sr. GPU Cloud Storage Solutions Expert (SRE SME)

Bitdeer Technologies Group • San Jose (CA)

On-site
USD 180,000 - 240,000
Sr. GPU Cloud Storage Solutions Expert (SRE SME)
Sr. GPU Cloud Storage Solutions Expert (SRE SME)

Bitdeer • San Jose (CA)

On-site
USD 180,000 - 240,000
SRE Platform Software Engineer (Early Career / Temporary)
SRE Platform Software Engineer (Early Career / Temporary)

Bitdeer Technologies Group • Austin (TX)

On-site
USD 110,000 - 140,000