AI Infra SRE - Kubernetes & GPU Cluster Reliability

Berrybytes

United States

On-site

USD 110,000 - 150,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Berrybytes is seeking an experienced AI Infra Engineer - SRE (Kubernetes) to join our Global Infrastructure team. You will be responsible for designing, operating, and optimizing Kubernetes-based infrastructure for AI workloads, ensuring maximum uptime and efficiency.

The ideal candidate has a Bachelor's degree in Computer Science, 3+ years of experience in data center operations, strong skills in Kubernetes, and familiarity with automation tools such as Terraform and Ansible. Join us to empower AI developers through cutting-edge technology.

Qualifications

  • 3+ years of experience in data center operations or site reliability engineering.
  • Strong background in automation tools like Terraform and Ansible.
  • Experience with observability stacks like Prometheus, Grafana, and Loki.

Responsibilities

  • Design and maintain scalable AI/ML infrastructure using Kubernetes.
  • Monitor GPU cluster performance and perform root-cause analysis.
  • Implement automation for infrastructure provisioning and management.
  • Lead incident response for issues related to GPUs and high-speed networks.

Skills

Infrastructure automation (Terraform, Ansible)
Kubernetes
Linux system administration
Observability stacks (Prometheus, Grafana, Loki)
GPU architecture knowledge

Education

Bachelor’s degree in Computer Science or related field

Tools

Kubernetes
NVIDIA GPU Operator
NVIDIA Network Operator
Slurm

Job description

Berrybytes is seeking an experienced AI Infra Engineer - SRE (Kubernetes) to join our Global Infrastructure team. You will be responsible for designing, operating, and optimizing Kubernetes-based infrastructure for AI workloads, ensuring maximum uptime and efficiency.

The ideal candidate has a Bachelor's degree in Computer Science, 3+ years of experience in data center operations, strong skills in Kubernetes, and familiarity with automation tools such as Terraform and Ansible. Join us to empower AI developers through cutting-edge technology.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

AI Infra Engineer – SRE (Kubernetes)
AI Infra Engineer – SRE (Kubernetes)

Berrybytes • United States

On-site
USD 110,000 - 150,000
Kubernetes SRE for AI Infra & GPU Clusters
Kubernetes SRE for AI Infra & GPU Clusters

GMI Cloud • United States

On-site
USD 100,000 - 130,000
AI Infra Engineer: Kubernetes on Bare Metal GPUs (Remote)
AI Infra Engineer: Kubernetes on Bare Metal GPUs (Remote)

vCluster • New York (NY)

Hybrid
USD 150,000 - 200,000
Competitive Salary
Platinum-Level Insurance
Flexible Working Schedule
+1
Senior AI Infrastructure Engineer — Kubernetes & GPU
Senior AI Infrastructure Engineer — Kubernetes & GPU

Seekr • Austin (TX)

Hybrid
USD 180,000 - 240,000
Equity ownership
Unlimited PTO
14 holidays
+4
Kubernetes & GPU Infra Architect for Scalable AI Clusters
Kubernetes & GPU Infra Architect for Scalable AI Clusters

NVIDIA Corporation • Santa Clara (CA)

Hybrid
USD 170,000 - 250,000
Infra Engineer - SRE(Kubernetes)
Infra Engineer - SRE(Kubernetes)

GMI Cloud • United States

On-site
USD 100,000 - 130,000
Senior Kubernetes & GPU AI Infra Engineer
Senior Kubernetes & GPU AI Infra Engineer

NVIDIA Corporation • Santa Clara (CA)

On-site
USD 184,000 - 357,000
Equity
Benefits
Remote AI Infrastructure Engineer — Kubernetes & GPU
Remote AI Infrastructure Engineer — Kubernetes & GPU

Gomyneed Private Limited • San Francisco (CA)

Hybrid
USD 121,000 - 137,000
Equity
Bonus
Senior AI Infrastructure Engineer - GPU & Kubernetes
Senior AI Infrastructure Engineer - GPU & Kubernetes

HCL Technologies Limited • California (MO)

On-site
USD 120,000 - 180,000
401(k) retirement plan
Paid time off (PTO)
Paid holidays
+1
AI Infrastructure Engineer: Kubernetes & GPU Clusters
AI Infrastructure Engineer: Kubernetes & GPU Clusters

NVIDIA • United States

Remote
USD 184,000 - 288,000