ML Systems Engineer: Training Clusters & Inference Cloud

Bison

San Francisco (CA)

On-site

USD 180,000 - 260,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Comprehensive medical, dental, vision
Competitive compensation
Relocation and immigration support
In-office snacks and meals
Unlimited PTO and holidays
In-person team in San Francisco

Job summary

Zyphra is hiring a Machine Learning Systems Administrator / DevOps Engineer in San Francisco. You will maintain and build the core infrastructure behind model training and inference, splitting time between large-scale training clusters and production deployments.

You’ll work with training, inference, and product teams to ensure reliability, security, and speed, and to lay groundwork for scalable workflows. Responsibilities include automating Linux clusters, managing access, monitoring resources,

Qualifications

  • Experience with Linux system administration and access management.
  • Scripting for automation (bash, Python).
  • Experience with containers (Docker) and orchestrators (Kubernetes / Slurm).
  • Production services experience with monitoring/alerting and CI/CD.

Responsibilities

  • Admin and automate large-scale training clusters.
  • Deploy, operate, and scale inference services across accelerators.
  • Manage containers, CI/CD, and rollout pipelines.
  • Build observability with metrics, logs, dashboards; incident postmortems.
  • Capacity planning, autoscaling, and cost tracking across hardware types.
  • Secure production systems with secrets, network policy, and isolation.

Skills

Linux admin
Scripting (bash, Python)
Docker
Kubernetes
Monitoring/Alerting
Incident response
IaC (Ansible, Terraform)
Cloud platforms (AWS/GCP/Azure)
GPU/ML infra knowledge

Tools

Docker
Kubernetes
Slurm
Prometheus
Grafana
Terraform
Ansible
Telegraf

Job description

Zyphra is hiring a Machine Learning Systems Administrator / DevOps Engineer in San Francisco. You will maintain and build the core infrastructure behind model training and inference, splitting time between large-scale training clusters and production deployments.

You’ll work with training, inference, and product teams to ensure reliability, security, and speed, and to lay groundwork for scalable workflows. Responsibilities include automating Linux clusters, managing access, monitoring resources,

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

ML Systems Ops Engineer: Training Clusters & Inference Cloud
ML Systems Ops Engineer: Training Clusters & Inference Cloud

Zyphra Technologies Inc. • San Francisco (CA)

On-site
USD 180,000 - 230,000
Comprehensive medical, dental, vision
401(k) plan
Relocation and immigration support
+3
ML Infra & DevOps Engineer: Training & Inference Cloud
ML Infra & DevOps Engineer: Training & Inference Cloud

Zyphra • San Francisco (CA)

On-site
USD 190,000 - 260,000
Medical, dental, vision plans
401(k) plan
Relocation support
+3
Machine Learning Systems Administrator / DevOps Engineer: Training Clusters & Inference Cloud
Machine Learning Systems Administrator / DevOps Engineer: Training Clusters & Inference Cloud

Zyphra Technologies Inc. • San Francisco (CA)

On-site
USD 180,000 - 230,000
Comprehensive medical, dental, vision
401(k) plan
Relocation and immigration support
+3
Machine Learning Systems Administrator / DevOps Engineer: Training Clusters & Inference Cloud
Machine Learning Systems Administrator / DevOps Engineer: Training Clusters & Inference Cloud

Bison • San Francisco (CA)

On-site
USD 180,000 - 260,000
Comprehensive medical, dental, vision
Competitive compensation
Relocation and immigration support
+3
Platform Engineer: ML Infra, Reliability & Scale
Platform Engineer: ML Infra, Reliability & Scale

Zyphra Technologies Inc. • San Francisco (CA)

On-site
USD 150,000 - 210,000
Comprehensive medical, dental, vision
401(k) plan
Relocation and immigration support
+3
Platform Engineer - AI Infra, ML Deployment, Unlimited PTO
Platform Engineer - AI Infra, ML Deployment, Unlimited PTO

Bison • San Francisco (CA)

On-site
USD 140,000 - 230,000
Medical, dental, vision
401(k) plan
Relocation and immigration support
+3
ML Systems Engineer: Training & Inference Infra
ML Systems Engineer: Training & Inference Infra

NextToken AI Inc. • Mountain View (CA)

On-site
USD 180,000 - 250,000
ML Systems Engineer: Scale Training & Inference
ML Systems Engineer: Scale Training & Inference

Doist • San Francisco (CA)

On-site
USD 180,000 - 230,000
Competitive cash compensation
Startup equity
Platform Engineer
Platform Engineer

Bison • San Francisco (CA)

On-site
USD 140,000 - 230,000
Medical, dental, vision
401(k) plan
Relocation and immigration support
+3
ML Systems Engineer — Training & Inference Infrastructure
ML Systems Engineer — Training & Inference Infrastructure

NextToken • Mountain View (CA)

On-site
USD 190,000 - 240,000