Cloud Platform Engineer - AI Inference & Reliability

SambaNova; San Jose (CA); On-site; USD 150,000 - 210,000; Full time

Benefits offered by this job

Equity

Flexible work environment

Comprehensive benefits

Job summary

SambaNova Systems is seeking a Cloud Platform Engineer to own the reliability of our AI inferencing service, ensuring uptime, low latency, and efficient resource use across regions. You will work across cloud providers and on-prem, participating in a shared on-call rotation to keep services resilient.

You will design monitoring, alerts, and auto-scaling, and drive IaC and CI/CD improvements to reduce toil and improve deployment. Strong SRE skills and cloud experience are essential.

Qualifications

• Bachelor's degree or equivalent experience in CS/engineering.
• 3–5+ years in a Site Reliability Engineer/DevOps role for large-scale services in public clouds.
• Strong programming/scripting in Python, Go, or Java.

Responsibilities

• Own and operate production inferencing service reliability, latency, and capacity across regions.
• Maintain 24/7 on-call readiness with blameless post-mortems and preventive actions.
• Build and maintain monitoring, alerting, dashboards, and auto-scaling for cost efficiency.
• Develop IaC and CI/CD pipelines for safe deployment of model versions and updates.
• Collaborate on capacity planning, cost optimization, and SLO/SLI reporting.
• Bridge cloud and on-prem infrastructure in a hybrid environment.

Skills

Site Reliability Engineering

Cloud platforms (AWS/GCP/Azure)

Python/Go/Java

Docker/Kubernetes

Monitoring (Prometheus, Grafana, Datad

IaC (Terraform/Ansible)

CI/CD (Jenkins, GitHub Actions, ArgoCD

On-call incident mgmt

Linux administration

Networking fundamentals

Education

Bachelor's degree in Computer Science or related field

Tools

Docker

Kubernetes

Prometheus

Grafana

Datadog

Terraform

CloudFormation

Jenkins

GitHub Actions

ArgoCD

Job description

SambaNova Systems is seeking a Cloud Platform Engineer to own the reliability of our AI inferencing service, ensuring uptime, low latency, and efficient resource use across regions. You will work across cloud providers and on-prem, participating in a shared on-call rotation to keep services resilient.

You will design monitoring, alerts, and auto-scaling, and drive IaC and CI/CD improvements to reduce toil and improve deployment. Strong SRE skills and cloud experience are essential.