Site Reliability Engineer — Build Scalable ML Infra

AI Fund; United States; Remote; USD 150,000 - 250,000; Full time

Benefits offered by this job

Unlimited PTO

401k

Healthcare premiums

Job summary

Baseten is seeking a Site Reliability Engineer to design and build robust, scalable infrastructure for ML deployments. You will automate deployments, monitor systems, and optimize performance while owning projects end-to-end.

You will collaborate with cross-functional teams, mentor teammates, and help drive reliability standards across Baseten’s platform. Prior ML experience isn’t required, but curiosity and quick learning are valued.

Qualifications

• Bachelor’s degree in CS, engineering, math, or related field.
• 3+ years in a fast-paced, high-growth environment.
• Extensive Kubernetes experience.
• Experience building and maintaining scalable infrastructure.
• Experience with infrastructure-as-code tools (Terraform, CloudFormation, Pulumi) and CI/CD tooling (GitHub Actions, GitLab CI, CircleCI, Jenkins).
• OSS observability experience (Prometheus, ELK, Grafana, OpenTelemetry) is a plus.
• Ability to own projects end-to-end, from spec to execution.
• No prior ML experience required, but willingness to learn.

Responsibilities

• Build and maintain scalable infrastructure to deploy and operate ML models.
• Set standards for reliability and performance across the infrastructure.
• Automate processes, especially CI/CD pipelines.
• Own projects end-to-end, balancing engineering and project management with user empathy.
• Collaborate with cross-functional teams to translate requirements into solutions.
• Mentor juniors and share knowledge within the org.
• Navigate ambiguity and simplify tool choices to avoid unnecessary complexity.
• Demonstrate ownership and accountability in all work.

Skills

Kubernetes

Cloud infrastructure

CI/CD tooling

IaC tools

Observability stacks

Project ownership

Learning orientation

Education

Bachelor’s degree in CS or related field

Advanced degree preferred

Tools

Terraform

CloudFormation

Pulumi

GitHub Actions

GitLab CI

CircleCI

Jenkins

Prometheus

ELK stack

Grafana

OpenTelemetry

Job description

Baseten is seeking a Site Reliability Engineer to design and build robust, scalable infrastructure for ML deployments. You will automate deployments, monitor systems, and optimize performance while owning projects end-to-end.

You will collaborate with cross-functional teams, mentor teammates, and help drive reliability standards across Baseten’s platform. Prior ML experience isn’t required, but curiosity and quick learning are valued.