Platform Engineer - AI Infra, ML Deployment, Unlimited PTO

Bison

San Francisco (CA)

On-site

USD 140,000 - 230,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Medical, dental, vision
401(k) plan
Relocation and immigration support
In-office snacks and meals
Unlimited PTO and holidays
In-person team in San Francisco

Job summary

Zyphra, an AI company based in San Francisco, is seeking a Platform Engineer to design and maintain the systems that keep infrastructure robust, observable, secure, and scalable for ML workloads.

You'll work with ML engineers, DevOps, and infra teams to boost reliability and performance, lead incident response and postmortems, and build tooling that makes infrastructure invisible and reliable for end users.

Qualifications

  • Experience in high-performance compute environments and ML clusters.
  • Background in infrastructure as code (Terraform, Ansible).
  • Familiarity with containers and scheduling systems (Docker, Kubernetes, Slurm).
  • Experience with ML/AI deployment release engineering is a plus.
  • Experience managing run-books, DRP, change management, and fault tolerance.
  • Experience with deployment strategies at scale.
  • Knowledge of compliance and audit standards in deployment and security.
  • Experience with load testing, fault injection, and chaos engineering.

Responsibilities

  • Design and maintain observability systems (monitoring, logging, alerting).
  • Manage infrastructure as a service across the stack and CI/CD coordination.
  • Design resilient build/deployment systems for research and production.
  • Implement secure release processes with auditability and rollback support.
  • Collaborate with ML engineers, DevOps, and infra teams to improve reliability.
  • Lead incident response, root-cause analysis, and postmortems.

Skills

HPC & ML clusters
Infrastructure as code
Containers & Kubernetes
ML release engineering
Incident response
Security & compliance

Tools

Terraform
Ansible
Docker
Kubernetes
Slurm
Apptainer
vLLM
Ray
SGLang
Triton

Job description

Zyphra, an AI company based in San Francisco, is seeking a Platform Engineer to design and maintain the systems that keep infrastructure robust, observable, secure, and scalable for ML workloads.

You'll work with ML engineers, DevOps, and infra teams to boost reliability and performance, lead incident response and postmortems, and build tooling that makes infrastructure invisible and reliable for end users.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Platform Engineer: ML Infra, Reliability & Scale
Platform Engineer: ML Infra, Reliability & Scale

Zyphra Technologies Inc. • San Francisco (CA)

On-site
USD 150,000 - 210,000
Comprehensive medical, dental, vision
401(k) plan
Relocation and immigration support
+3
Platform Engineer
Platform Engineer

Bison • San Francisco (CA)

On-site
USD 140,000 - 230,000
Medical, dental, vision
401(k) plan
Relocation and immigration support
+3
Platform Engineer
Platform Engineer

Zyphra Technologies Inc. • San Francisco (CA)

On-site
USD 150,000 - 210,000
Comprehensive medical, dental, vision
401(k) plan
Relocation and immigration support
+3
ML Infra & DevOps Engineer: Training & Inference Cloud
ML Infra & DevOps Engineer: Training & Inference Cloud

Zyphra • San Francisco (CA)

On-site
USD 190,000 - 260,000
Medical, dental, vision plans
401(k) plan
Relocation support
+3
Machine Learning Systems Administrator / DevOps Engineer: Training Clusters & Inference Cloud
Machine Learning Systems Administrator / DevOps Engineer: Training Clusters & Inference Cloud

Zyphra Technologies Inc. • San Francisco (CA)

On-site
USD 180,000 - 230,000
Comprehensive medical, dental, vision
401(k) plan
Relocation and immigration support
+3
Platform Engineer (Remote) - AI-Powered 0-to-1 Systems
Platform Engineer (Remote) - AI-Powered 0-to-1 Systems

Confidential • United States

Remote
USD 120,000 - 160,000
AI Engineer
AI Engineer

Zyphra • Palo Alto (CA)

On-site
USD 120,000 - 160,000
Comprehensive medical, dental, vision, and FSA plans
Competitive compensation and 401(k) matching
On-site meals
+1
ML Systems Engineer: Training Clusters & Inference Cloud
ML Systems Engineer: Training Clusters & Inference Cloud

Bison • San Francisco (CA)

On-site
USD 180,000 - 260,000
Comprehensive medical, dental, vision
Competitive compensation
Relocation and immigration support
+3
Machine Learning Systems Administrator / DevOps Engineer: Training Clusters & Inference Cloud
Machine Learning Systems Administrator / DevOps Engineer: Training Clusters & Inference Cloud

Bison • San Francisco (CA)

On-site
USD 180,000 - 260,000
Comprehensive medical, dental, vision
Competitive compensation
Relocation and immigration support
+3
Machine Learning Systems Administrator / DevOps Engineer: Training Clusters & Inference Cloud
Machine Learning Systems Administrator / DevOps Engineer: Training Clusters & Inference Cloud

Zyphra • San Francisco (CA)

On-site
USD 190,000 - 260,000
Medical, dental, vision plans
401(k) plan
Relocation support
+3