Software Engineer, Cloud Platform

present of AI

San Francisco (CA)

On-site

USD 180,000 - 240,000

Full time

4 hours ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Baseten seeks an engineer to own the Kubernetes fleet powering production AI workloads. You will transform manual cluster operations into reliable, repeatable systems and apply your deep Kubernetes expertise, including controllers and operators, with Terraform and GitOps tooling.

From design to production, you’ll balance reliability with fast rollout paths, communicating tradeoffs clearly. Expect to work on GPU-inference workloads, expanding cloud and GPU provider integration while maintaining

Qualifications

  • Hands-on experience building and operating infrastructure software.
  • Deep Kubernetes knowledge including controllers and operators.
  • Practical use of Terraform and GitOps tools.

Responsibilities

  • Own the Kubernetes fleet behind production AI workloads.
  • Turn manual cluster operations into reliable, repeatable systems.
  • Design through production with focus on reliability and safe rollout paths.

Skills

Kubernetes controllers
Go backend development
Production infra ownership
Reliability engineering

Tools

Kubernetes
Terraform
GitOps
Spark
Linux

Job description

This role asks for someone who can own the Kubernetes fleet behind production AI workloads, turning manual cluster operations into reliable, repeatable systems. A strong candidate brings hands on experience building and operating infrastructure software, deep Kubernetes knowledge including controllers and operators, and practical use of Terraform and GitOps tools. The work spans design through production, so sound judgment about reliability and clear communication of tradeoffs matter.

How it fits the AI era

AI changes the work by making GPU capacity and inference workloads central, so the platform must bring new cloud and GPU providers online quickly and safely. Automation and controllers handle routine cluster lifecycle tasks, while humans focus on designing safe rollout paths, diagnosing failures, and making judgment calls about production risk. The role stays human in turning ambiguous operational problems into maintainable software and in deciding how changes reach the fleet.

How it builds AI experience

The AI experience gained comes from operating the infrastructure that serves open source and custom models for AI companies, including GPU capacity management and fleet upgrades. Building controllers and GitOps configuration for inference workloads gives direct exposure to how AI models are deployed and scaled in production. To build that experience, one could practice with Kubernetes operators, Terraform modules, and staged rollouts on GPU infrastructure.

Worth showing
  • Kubernetes controllers and operators
  • Go backend development
  • Terraform and GitOps
  • Production infrastructure ownership

This is our own read, written from the employer's posting and the company's Spotlight. The employer's posting is the source of truth for the role.

About Baseten

High-performance cloud inference platform for deploying, serving, and scaling open-source and custom artificial intelligence models.

Tools mentioned: Kubernetes, Terraform, Go, Spark, Linux, machine learning

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Software Engineer - Training Infrastructure
Software Engineer - Training Infrastructure

present of AI • San Francisco (CA)

On-site
USD 190,000 - 260,000
Forward Deployed Engineer (Training)
Forward Deployed Engineer (Training)

present of AI • San Francisco (CA)

On-site
USD 150,000 - 230,000
Global Capacity Manager
Global Capacity Manager

present of AI • San Francisco (CA)

Remote
USD 190,000 - 260,000
Software Engineer, Cloud Platform
Software Engineer, Cloud Platform

Linuxconfig • San Francisco (CA)

On-site
USD 150,000 - 210,000
Equity
Medical, dental, and vision insurance
Flexible PTO
+3
Software Engineer, Cloud Platform
Software Engineer, Cloud Platform

Candidate • San Francisco (CA)

On-site
USD 150,000 - 210,000
Equity
Medical, dental, vision insurance (US)
Flexible PTO
+3
Software Engineer, Cloud Platform
Software Engineer, Cloud Platform

Baseten • San Francisco (CA)

On-site
USD 180,000 - 240,000
Equity
Medical, dental, and vision coverage
Flexible PTO
+2
Kubernetes Platform Engineer for AI Inference
Kubernetes Platform Engineer for AI Inference

present of AI • San Francisco (CA)

On-site
USD 180,000 - 240,000
Software Engineer, Cloud Platform
Software Engineer, Cloud Platform

ResumeXrays LLC • San Francisco (CA)

On-site
USD 180,000 - 240,000
Competitive equity package
Medical, dental, vision for all
Flexible PTO including Winter Break
+4
Product Platform: Backend Engineer
Product Platform: Backend Engineer

present of AI • San Francisco (CA)

On-site
USD 140,000 - 200,000
Software Engineer, Cloud Platform
Software Engineer, Cloud Platform

Baseten • United States

On-site
USD 150,000 - 230,000
Medical, dental, vision coverage
Flexible PTO incl. Winter Break
Parental leave
+3