ML Infra & DevOps Engineer: Training & Inference Cloud

Zyphra

San Francisco (CA)

On-site

USD 190,000 - 260,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Medical, dental, vision plans
401(k) plan
Relocation support
In-office meals
Unlimited PTO
Team in San Francisco

Job summary

Zyphra is seeking a Machine Learning Systems Administrator / DevOps Engineer to maintain and build the core infrastructure behind model training and inference clouds. You will split time between large-scale training clusters and production deployments across heterogeneous accelerators, ensuring reliability, security, and performance.

You will own onboarding, access control, monitoring, autoscaling, and observability, while collaborating with training, inference, and product teams to scale

Qualifications

  • Experience with Linux system administration, user/access management and automation.
  • Scripting expertise in Bash and Python for tooling.
  • Experience with containers (Docker) and schedulers/orchestrators (Slurm, Kubernetes).
  • Experience running production services with monitoring/alerting and deployment pipelines.

Responsibilities

  • Administer and automate Linux clusters used for training and inference.
  • Manage access control, security auditing, and onboarding/offboarding.
  • Monitor resources, job scheduling, and cluster health.
  • Support and improve developer workflows (VSCode remote dev, Docker).
  • Deploy, operate, and scale inference services across accelerators.

Skills

Linux admin
Bash/Python
Docker
Kubernetes
Prometheus/Grafana
Automation

Tools

Slurm
Ansible
Terraform
CI/CD pipelines
Cloud (AWS/GCP/Azure)

Job description

Zyphra is seeking a Machine Learning Systems Administrator / DevOps Engineer to maintain and build the core infrastructure behind model training and inference clouds. You will split time between large-scale training clusters and production deployments across heterogeneous accelerators, ensuring reliability, security, and performance.

You will own onboarding, access control, monitoring, autoscaling, and observability, while collaborating with training, inference, and product teams to scale

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

ML Systems Ops Engineer: Training Clusters & Inference Cloud
ML Systems Ops Engineer: Training Clusters & Inference Cloud

Zyphra Technologies Inc. • San Francisco (CA)

On-site
USD 180,000 - 230,000
Comprehensive medical, dental, vision
401(k) plan
Relocation and immigration support
+3
ML Systems Engineer: Training Clusters & Inference Cloud
ML Systems Engineer: Training Clusters & Inference Cloud

Bison • San Francisco (CA)

On-site
USD 180,000 - 260,000
Comprehensive medical, dental, vision
Competitive compensation
Relocation and immigration support
+3
Machine Learning Systems Administrator / DevOps Engineer: Training Clusters & Inference Cloud
Machine Learning Systems Administrator / DevOps Engineer: Training Clusters & Inference Cloud

Zyphra Technologies Inc. • San Francisco (CA)

On-site
USD 180,000 - 230,000
Comprehensive medical, dental, vision
401(k) plan
Relocation and immigration support
+3
Platform Engineer: ML Infra, Reliability & Scale
Platform Engineer: ML Infra, Reliability & Scale

Zyphra Technologies Inc. • San Francisco (CA)

On-site
USD 150,000 - 210,000
Comprehensive medical, dental, vision
401(k) plan
Relocation and immigration support
+3
Machine Learning Systems Administrator / DevOps Engineer: Training Clusters & Inference Cloud
Machine Learning Systems Administrator / DevOps Engineer: Training Clusters & Inference Cloud

Bison • San Francisco (CA)

On-site
USD 180,000 - 260,000
Comprehensive medical, dental, vision
Competitive compensation
Relocation and immigration support
+3
Platform Engineer - AI Infra, ML Deployment, Unlimited PTO
Platform Engineer - AI Infra, ML Deployment, Unlimited PTO

Bison • San Francisco (CA)

On-site
USD 140,000 - 230,000
Medical, dental, vision
401(k) plan
Relocation and immigration support
+3
Machine Learning Systems Administrator / DevOps Engineer: Training Clusters & Inference Cloud
Machine Learning Systems Administrator / DevOps Engineer: Training Clusters & Inference Cloud

Zyphra • San Francisco (CA)

On-site
USD 190,000 - 260,000
Medical, dental, vision plans
401(k) plan
Relocation support
+3
Platform Engineer
Platform Engineer

Zyphra Technologies Inc. • San Francisco (CA)

On-site
USD 150,000 - 210,000
Comprehensive medical, dental, vision
401(k) plan
Relocation and immigration support
+3
Platform Engineer
Platform Engineer

Bison • San Francisco (CA)

On-site
USD 140,000 - 230,000
Medical, dental, vision
401(k) plan
Relocation and immigration support
+3
ML Systems Engineer: Training & Inference Infra
ML Systems Engineer: Training & Inference Infra

NextToken AI Inc. • Mountain View (CA)

On-site
USD 180,000 - 250,000