Software Engineer, Cloud Platform

Baseten

Toronto

On-site

CAD 235,000 - 471,000

Full time

3 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Competitive compensation, including
(U.S. only) 100% coverage of medical,
Flexible PTO policy including company
Paid parental leave
Fertility and family-building stipend
(U.S. only) Company-facilitated 401(k)
Exposure to a variety of ML startups

Job summary

Baseten seeks a hands-on Cloud Platform Engineer to own the Kubernetes fleet powering AI workloads. You will convert manual operations into reliable, repeatable systems, bring new cloud providers online, and safely roll out upgrades across the fleet.

You will build APIs, controllers, and automation to simplify infrastructure, enable GPU capacity, and support rapid AI inference growth with strong Go and Kubernetes experience.

Qualifications

  • Experience building and owning production infrastructure software or distributed systems.
  • Strong programming skills in Go or another systems or backend language.
  • Deep experience with Kubernetes infrastructure, including developing controllers or operators and understanding reconciliation, custom resources, and failure handling.
  • Practical experience with infrastructure as code and GitOps tools such as Terraform and Flux or Argo CD.
  • Strong Linux, networking, and debugging fundamentals, with sound judgment about reliability and the impact of production changes.
  • Ability to turn ambiguous operational problems into maintainable software and communicate design tradeoffs clearly.

Responsibilities

  • Design, build, and operate services, APIs, and Kubernetes controllers that automate cluster lifecycle management.
  • Develop reusable Terraform modules and GitOps configuration that work across cloud and GPU infrastructure providers.
  • Make infrastructure changes safe through validation, staged rollouts, clear ownership boundaries, and tested recovery paths.
  • Build observability into automation so engineers can understand progress, diagnose failures, and retry operations safely.
  • Partner with infrastructure and workload teams to define platform interfaces, resolve operational pain points, and take projects from design through adoption.

Skills

Go
Kubernetes
Linux
Networking
Debugging

Tools

Terraform
Flux
Argo CD
GitOps

Job description

About Baseten Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma, and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. We're growing quickly and recently raised our $1.5B Series F, led by Altimeter Capital, Conviction Partners, and Spark Capital. Join us and help build the platform engineers turn to ship AI products.

About Baseten Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma, and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. We're growing quickly and recently raised our $1.5B Series F, led by Altimeter Capital, Conviction Partners, and Spark Capital. Join us and help build the platform engineers turn to ship AI products.

THE ROLE

Join Cloud Platform Engineering to own the Kubernetes fleet that runs our production AI workloads. You’ll turn manual cluster operations into reliable, repeatable systems—from bringing new cloud providers online to rolling out configuration and upgrades safely across the entire fleet.

This is a hands-on software engineering role with ownership from design through production. You’ll build APIs, controllers, and automation that make infrastructure easier to operate, reduce configuration drift, and bring GPU capacity online seamlessly to power the AI inference business growth.

EXAMPLE INITIATIVES
  • Unify Kubernetes platform configuration under GitOps, replacing duplicated cluster manifests with shared configuration and explicit provider overrides.
  • Automate cluster onboarding and provisioning with reusable infrastructure templates, readiness checks, and recoverable workflows.
  • Build controllers and rollout mechanisms for fleet upgrades and workload-aware maintenance.
Responsibilities
  • Design, build, and operate services, APIs, and Kubernetes controllers that automate cluster lifecycle management.
  • Develop reusable Terraform modules and GitOps configuration that work across cloud and GPU infrastructure providers.
  • Make infrastructure changes safe through validation, staged rollouts, clear ownership boundaries, and tested recovery paths.
  • Build observability into automation so engineers can understand progress, diagnose failures, and retry operations safely.
  • Partner with infrastructure and workload teams to define platform interfaces, resolve operational pain points, and take projects from design through adoption.
Requirements
  • Experience building and owning production infrastructure software or distributed systems.
  • Strong programming skills in Go or another systems or backend language, with the ability to contribute to a Go codebase.
  • Deep experience with Kubernetes infrastructure, including developing controllers or operators and understanding reconciliation, custom resources, and failure handling.
  • Practical experience with infrastructure as code and GitOps tools such as Terraform and Flux or Argo CD.
  • Strong Linux, networking, and debugging fundamentals, with sound judgment about reliability and the impact of production changes.
  • Ability to turn ambiguous operational problems into maintainable software and communicate design tradeoffs clearly.
NICE TO HAVE
  • Experience managing Kubernetes fleets across multiple clouds or GPU infrastructure providers.
  • Contributions to Kubernetes or infrastructure open source projects, or experience with workflow orchestration and progressive delivery.
Benefits
  • Competitive compensation, including meaningful equity
  • (U.S. only) 100% coverage of medical, dental, and vision insurance for employee and dependents
  • Flexible PTO policy including company wide Winter Break (our offices are closed from Christmas Eve to New Year's Day!)
  • Paid parental leave
  • Fertility and family-building stipend through Carrot
  • (U.S. only) Company-facilitated 401(k)
  • Exposure to a variety of ML startups, offering unparalleled learning and networking opportunities.

At Baseten, we are committed to fostering a diverse and inclusive workplace. We provide equal employment opportunities to all employees and applicants without regard to race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, or veteran status.

We are an Equal Opportunity Employer and will consider qualified applicants with criminal histories in a manner consistent with applicable law (by example, the requirements of the San Francisco Fair Chance Ordinance, where applicable).

Compensation Range: $165K - $330K

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Software Engineer, Cloud Platform
Software Engineer, Cloud Platform

Baseten • Montreal

On-site
CAD 235,000 - 471,000
Competitive salary & equity
Flexible PTO with Winter Break
Paid parental leave
+3
Platform Engineer — CI/CD, Kubernetes & Go/Python
Platform Engineer — CI/CD, Kubernetes & Go/Python

Baseten • Montreal

On-site
CAD 230,000 - 460,000
Equity
Medical/Dental/Vision
Flexible PTO
+4
Cloud Platform Engineer
Cloud Platform Engineer

Baseten • Montreal

On-site
CAD 230,000 - 461,000
Equity
Medical, dental, and vision insurance
Flexible PTO including Winter Break
+3
Cloud Platform Engineer
Cloud Platform Engineer

Baseten • Toronto

On-site
CAD 230,000 - 461,000
Competitive compensation + equity
Winter Break PTO
Paid parental leave
+1
Software Engineer - Continuous Delivery
Software Engineer - Continuous Delivery

Baseten • Montreal

On-site
CAD 230,000 - 460,000
Equity
Medical/Dental/Vision
Flexible PTO
+4
AI Inference Engineer
AI Inference Engineer

Baseten • Montreal

On-site
CAD 231,000 - 462,000
Competitive compensation with equity
Comprehensive health insurance
Flexible PTO incl. Winter Break
+4
Software Engineer- Inference Platform
Software Engineer- Inference Platform

Baseten • Montreal

On-site
CAD 256,000 - 512,000
Competitive compensation, including 1+
(U.S. only) 100% coverage of medical,?
Flexible PTO policy including Winter
+4
AI Inference Engineer
AI Inference Engineer

Urban Ridge Supplies • Toronto

On-site
CAD 233,000 - 466,000
Equity
Flexible PTO
Parental leave
+3
Software Engineer - Infrastructure
Software Engineer - Infrastructure

Baseten • Toronto

On-site
CAD 230,000 - 461,000
Competitive compensation including ̶e̶
Equity included
Flexible PTO including company Winter
Forward Deployed Engineer
Forward Deployed Engineer

Baseten • Toronto

On-site
CAD 230,000 - 461,000
Competitive compensation and equity
Flexible PTO including Winter Break
Paid parental leave
+2