Staff Software Engineer, Inference Platform Architect

Cerebras

Sunnyvale (CA)

On-site

USD 210,000 - 260,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Cerebras is hiring a Staff Engineer for the Inference Platform team in Sunnyvale. You will lead and contribute to a datacenter-scale cluster orchestration layer, connecting cloud components with ML services, while solving hard problems in Kubernetes operators, security, and CI/CD.

You will influence platform direction, drive latency and resilience, and write production-grade code in Go or C++, shaping the technical bar across cross-functional teams.

Qualifications

  • 8+ years building and operating large-scale distributed systems or cloud infrastructure.
  • Deep expertise in distributed systems architecture, preferably with Kubernetes.
  • Proven track record making high-availability, low-latency architectural decisions.
  • Security experience (certificates, TLS, mTLS).
  • Experience reducing tail-latency and optimizing latency/throughput in high-QPS systems.
  • Strong proficiency in Go or C++, able to contribute production code.
  • Experience in observability, metrics, logging, tracing, and SLO-driven ops.
  • Ability to influence senior engineers and cross-functional partners with credibility.

Responsibilities

  • Design, develop, test, and maintain production software across a broad stack.
  • Raise senior engineers through design feedback and clear standards.
  • Shape technical direction for the Inference Platform and Kubernetes CRDs.
  • Architect active-active systems with rapid failover and defined SLOs.
  • Make high-consequence architectural decisions and drive roadmap for key areas.
  • Lead on production issues, incident response, and post-incident improvements.
  • Collaborate with ML, Product, Infrastructure, and Cloud teams to align on design decisions.

Skills

Distributed systems
Kubernetes
Go
C++
TLS/mTLS security
Observability
Leadership
Backend systems

Tools

CI/CD tooling

Job description

Cerebras is hiring a Staff Engineer for the Inference Platform team in Sunnyvale. You will lead and contribute to a datacenter-scale cluster orchestration layer, connecting cloud components with ML services, while solving hard problems in Kubernetes operators, security, and CI/CD.

You will influence platform direction, drive latency and resilience, and write production-grade code in Go or C++, shaping the technical bar across cross-functional teams.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Staff Engineer, Inference Platform & Kubernetes
Staff Engineer, Inference Platform & Kubernetes

FDE Times • Sunnyvale (CA)

On-site
USD 210,000 - 270,000
Senior Platform & DevOps Engineer for AI Inference Core
Senior Platform & DevOps Engineer for AI Inference Core

Precision Labs • Sunnyvale (CA)

Hybrid
USD 180,000 - 260,000
Senior Inference Platform Engineer
Senior Inference Platform Engineer

Cerebras • Sunnyvale (CA)

On-site
USD 150,000 - 210,000
Senior AI Inference Platform Engineer
Senior AI Inference Platform Engineer

Cerebras • Sunnyvale (CA)

On-site
USD 140,000 - 190,000
Senior DevOps Engineer - AI Inference Platform
Senior DevOps Engineer - AI Inference Platform

FDE Times • Sunnyvale (CA)

On-site
USD 150,000 - 210,000
Staff Software Engineer, Inference Platform
Staff Software Engineer, Inference Platform

Cerebras • Sunnyvale (CA)

On-site
USD 210,000 - 260,000
Staff Software Engineer, Inference Platform
Staff Software Engineer, Inference Platform

FDE Times • Sunnyvale (CA)

On-site
USD 210,000 - 270,000
Software Engineer, Inference Platform
Software Engineer, Inference Platform

Cerebras • Sunnyvale (CA)

On-site
USD 150,000 - 210,000
Senior Platform Engineer: AI Infra & CI/CD Mastery
Senior Platform Engineer: AI Infra & CI/CD Mastery

Cerebras • Sunnyvale (CA)

On-site
USD 140,000 - 210,000
Senior Backend Engineer — Inference Cloud
Senior Backend Engineer — Inference Cloud

Cerebras • Sunnyvale (CA)

On-site
USD 180,000 - 260,000