GPU AI Inference Systems Engineer & SRE

Bellatrix Systems LLC

San Jose (CA)

On-site

USD 180,000 - 240,000

Full time

2 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Bellatrix Systems LLC in San Jose, CA invites an experienced Systems Engineer / SRE to design, automate, and maintain large-scale AI inference infrastructure. You will focus on GPU cluster reliability, bare-metal provisioning, Kubernetes orchestration, and Linux performance optimization to support distributed accelerator environments.

The role emphasizes high availability, scalability, and performance. You will implement monitoring, telemetry, automated recovery, and root-cause analysis to

Qualifications

  • Experience in hyperscale or GPU cloud infrastructure.
  • Experience with NVIDIA GPU drivers, CUDA, Fabric Managers, NCCL.
  • Kubernetes cluster management at scale.
  • Programming in Python or Go.
  • GPU networking: RoCEv2/InfiniBand.
  • SLIs/SLOs, telemetry, automated self-healing, root-cause analysis.

Responsibilities

  • Design and maintain scalable GPU infrastructure for AI inference workloads.
  • Automate bare-metal provisioning and server lifecycle management.
  • Manage Kubernetes clusters and optimize Linux/GPU performance.
  • Troubleshoot GPU, network, and distributed system bottlenecks.
  • Implement monitoring, telemetry, and automated recovery solutions.
  • Conduct root-cause analysis and improve infrastructure reliability.

Skills

Hyperscale infra
Distributed systems
NVIDIA drivers
CUDA
Fabric Managers
NCCL
Kubernetes at scale
Python
Go
RoCEv2
InfiniBand
SLIs/SLOs
Telemetry
Self-healing
Root-cause

Job description

Bellatrix Systems LLC in San Jose, CA invites an experienced Systems Engineer / SRE to design, automate, and maintain large-scale AI inference infrastructure. You will focus on GPU cluster reliability, bare-metal provisioning, Kubernetes orchestration, and Linux performance optimization to support distributed accelerator environments.

The role emphasizes high availability, scalability, and performance. You will implement monitoring, telemetry, automated recovery, and root-cause analysis to

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Systems Engineer / Site Reliability Engineer (SRE)
Systems Engineer / Site Reliability Engineer (SRE)

Bellatrix Systems LLC • San Jose (CA)

On-site
USD 180,000 - 240,000
AI Infrastructure Engineer - GPU/HPC & SRE
AI Infrastructure Engineer - GPU/HPC & SRE

CELOTTI TECH TALENT (SINGAPORE) PTE. LTD. • Palo Alto (CA)

On-site
USD 150,000 - 230,000
Lead Large-Scale GPU Cluster Engineer for AI Research
Lead Large-Scale GPU Cluster Engineer for AI Research

Linuxcareers • San Francisco (CA)

On-site
USD 120,000 - 180,000
AI Infra SRE: Build Reliable GPU & Cluster Systems
AI Infra SRE: Build Reliable GPU & Cluster Systems

Boson AI • United States

Remote
USD 125,000 - 250,000
Staff GPU Inference Engineer — Production AI Acceleration
Staff GPU Inference Engineer — Production AI Acceleration

Cerebras • Sunnyvale (CA)

On-site
USD 250,000 - 360,000
Breakthrough AI platform
Open source research
Work on one of the fastest AI superwec
+2
Senior AI Inference Reliability Engineer - GPU & Kubernetes
Senior AI Inference Reliability Engineer - GPU & Kubernetes

Fdetimes • San Francisco (CA)

On-site
USD 160,000 - 280,000
Equity
Health insurance
AI Infra & Cluster Engineer — Scale GPU/CPU Orchestration
AI Infra & Cluster Engineer — Scale GPU/CPU Orchestration

Linuxcareers • San Francisco (CA)

On-site
USD 120,000 - 160,000
Principal AI Systems Engineer, GPU Compute Infra
Principal AI Systems Engineer, GPU Compute Infra

Highrise AI • United States

Hybrid
USD 180,000 - 280,000
Staff Engineer, Scalable AI Inference Platform
Staff Engineer, Scalable AI Inference Platform

Salient Group • San Francisco (CA)

On-site
USD 180,000 - 260,000
GPU & Kubernetes SRE Engineer for AI Infrastructure
GPU & Kubernetes SRE Engineer for AI Infrastructure

Together Computer Inc • United States

Remote
USD 140,000 - 190,000