Platform Engineer: ML Infra, Reliability & Scale

Zyphra Technologies Inc.

San Francisco (CA)

On-site

USD 150,000 - 210,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Comprehensive medical, dental, vision
401(k) plan
Relocation and immigration support
In-office snacks and meals
Unlimited PTO and holidays
In-person team in San Francisco

Job summary

Zyphra Technologies Inc. in San Francisco is seeking a Platform Engineer to design and maintain robust, observable, and secure compute environments for ML workloads. You’ll build reliable release processes and scalable infrastructure, collaborating with ML engineers, DevOps, and infra teams.

You’ll lead incident response, implement IaC, and drive reproducible runs across research and production. If you love building systems that empower teams to move fast while staying safe and auditable, this

Qualifications

  • Experience in HPC and ML compute clusters plus hyperscaler clouds (AWS, GCP).
  • Infrastructure as code experience (Terraform, Ansible).
  • Containers and scheduling systems (Docker, Kubernetes, Slurm).
  • Experience with ML/AI release engineering is a plus.
  • Run-books, DRP, change management and fault tolerance.
  • Deployment strategies at scale.
  • Reliable environments for experimental workloads and reproducible runs.
  • Knowledge of deployment security and audit standards.
  • Load testing, fault injection, chaos engineering.
  • Building tooling to make infrastructure invisible and reliable for end users.

Responsibilities

  • Build observability systems (monitoring, logging, alerting).
  • Manage IaaS across the stack with CI/CD in partnership with eng teams.
  • Design resilient build and deployment systems for research and production.
  • Implement secure release processes with auditability and rollback support.
  • Collaborate with ML engineers, DevOps, and infra teams to improve reliability and performance.
  • Lead incident response, root-cause analysis, and postmortems.

Skills

HPC environments
Cloud platforms
CI/CD pipelines
Incident response
DR/Change management
Chaos engineering
Infra tooling
Security/compliance awareness

Tools

Terraform
Ansible
Docker
Apptainer
Kubernetes
Slurm
vLLM
Ray
SGLang
Triton

Job description

Zyphra Technologies Inc. in San Francisco is seeking a Platform Engineer to design and maintain robust, observable, and secure compute environments for ML workloads. You’ll build reliable release processes and scalable infrastructure, collaborating with ML engineers, DevOps, and infra teams.

You’ll lead incident response, implement IaC, and drive reproducible runs across research and production. If you love building systems that empower teams to move fast while staying safe and auditable, this

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Platform Engineer - AI Infra, ML Deployment, Unlimited PTO
Platform Engineer - AI Infra, ML Deployment, Unlimited PTO

Bison • San Francisco (CA)

On-site
USD 140,000 - 230,000
Medical, dental, vision
401(k) plan
Relocation and immigration support
+3
Platform Engineer
Platform Engineer

Zyphra Technologies Inc. • San Francisco (CA)

On-site
USD 150,000 - 210,000
Comprehensive medical, dental, vision
401(k) plan
Relocation and immigration support
+3
Platform Engineer
Platform Engineer

Bison • San Francisco (CA)

On-site
USD 140,000 - 230,000
Medical, dental, vision
401(k) plan
Relocation and immigration support
+3
ML Infra & DevOps Engineer: Training & Inference Cloud
ML Infra & DevOps Engineer: Training & Inference Cloud

Zyphra • San Francisco (CA)

On-site
USD 190,000 - 260,000
Medical, dental, vision plans
401(k) plan
Relocation support
+3
ML Systems Engineer: Training Clusters & Inference Cloud
ML Systems Engineer: Training Clusters & Inference Cloud

Bison • San Francisco (CA)

On-site
USD 180,000 - 260,000
Comprehensive medical, dental, vision
Competitive compensation
Relocation and immigration support
+3
ML Systems Ops Engineer: Training Clusters & Inference Cloud
ML Systems Ops Engineer: Training Clusters & Inference Cloud

Zyphra Technologies Inc. • San Francisco (CA)

On-site
USD 180,000 - 230,000
Comprehensive medical, dental, vision
401(k) plan
Relocation and immigration support
+3
Senior ML Platform Engineer: Scale Production ML
Senior ML Platform Engineer: Scale Production ML

Zions Bancorporation • Midvale (UT)

Hybrid
USD 125,000 - 180,000
Medical Dental and Vision Insurance -
Life and Disability Insurance, Parenal
HSA/FSA and Dependent Care Accounts
+5
ML Platform Engineer: Production ML at Scale
ML Platform Engineer: Production ML at Scale

Zionsbancorp • United States

Hybrid
USD 140,000 - 190,000
Medical, Dental and Vision – Start Day
401(k) with Company Match
Parental Leave and Adoption Support
+3
Platform Engineer — Build & Own Infra for Deployments
Platform Engineer — Build & Own Infra for Deployments

Fig Technology Inc. • San Francisco (CA)

Hybrid
USD 200,000 - 280,000
Staff Platform Infra Engineer — Scale & Reliability
Staff Platform Infra Engineer — Scale & Reliability

Zūm • Redwood City (CA)

On-site
USD 240,000 - 280,000
Medical
Dental
Vision
+5