Site Reliability Engineer

AI Fund; United States; Remote; USD 150,000 - 250,000; Full time

Benefits offered by this job

Unlimited PTO

401k

Healthcare premiums

Job summary

Baseten is seeking a Site Reliability Engineer to design and build robust, scalable infrastructure for ML deployments. You will automate deployments, monitor systems, and optimize performance while owning projects end-to-end.

You will collaborate with cross-functional teams, mentor teammates, and help drive reliability standards across Baseten’s platform. Prior ML experience isn’t required, but curiosity and quick learning are valued.

Qualifications

• Bachelor’s degree in CS, engineering, math, or related field.
• 3+ years in a fast-paced, high-growth environment.
• Extensive Kubernetes experience.
• Experience building and maintaining scalable infrastructure.
• Experience with infrastructure-as-code tools (Terraform, CloudFormation, Pulumi) and CI/CD tooling (GitHub Actions, GitLab CI, CircleCI, Jenkins).
• OSS observability experience (Prometheus, ELK, Grafana, OpenTelemetry) is a plus.
• Ability to own projects end-to-end, from spec to execution.
• No prior ML experience required, but willingness to learn.

Responsibilities

• Build and maintain scalable infrastructure to deploy and operate ML models.
• Set standards for reliability and performance across the infrastructure.
• Automate processes, especially CI/CD pipelines.
• Own projects end-to-end, balancing engineering and project management with user empathy.
• Collaborate with cross-functional teams to translate requirements into solutions.
• Mentor juniors and share knowledge within the org.
• Navigate ambiguity and simplify tool choices to avoid unnecessary complexity.
• Demonstrate ownership and accountability in all work.

Skills

Kubernetes

Cloud infrastructure

CI/CD tooling

IaC tools

Observability stacks

Project ownership

Learning orientation

Education

Bachelor’s degree in CS or related field

Advanced degree preferred

Tools

Terraform

CloudFormation

Pulumi

GitHub Actions

GitLab CI

CircleCI

Jenkins

Prometheus

ELK stack

Grafana

OpenTelemetry

Job description

ABOUT BASETEN

We’re a growing team of builders backed by top-tier investors, including IVP, Spark Capital, Greylock, and Sarah Guo at Conviction. ML teams at enterprises and category-defining AI-native companies like Descript, Bland.ai, Patreon, Writer, and Robust Intelligence use Baseten to power their core production workloads with best-in-class performance, security, and reliability. While we’ve unlocked PMF and secured Series B funding, the ML infrastructure market is massive, and we’re just getting started. If you’re excited to work on engaging and relevant problems while building something new from the ground up, come join us!

THE ROLE

As a Site Reliability Engineer, you’ll envision and build robust systems and processes that ensure our infrastructure is scalable, reliable, and efficient. This can range from automating deployments and monitoring systems to optimizing performance and managing incidents.

We all work closely with our users, learning from their past struggles in operationalizing ML, onboarding them onto our platform, and turning our learnings into ideas for improving Baseten.

RESPONSIBILITIES:

• Build and maintain scalable infrastructure to support the deployment and operation of machine learning models.

• Establish standards and best practices for reliability and performance across the infrastructure.

• Automate processes when relevant, particularly for managing CI/CD pipelines.

• Own products and projects end-to-end, functioning as both an engineer and a project manager, with a focus on user empathy, project specification, and end-to-end execution.

• Collaborate with cross-functional teams to understand project requirements and translate them into technical solutions.

• Mentor junior team members and contribute to knowledge sharing within the organization.

• Navigate ambiguity and exercise good judgment on tradeoffs and tools needed to solve problems, avoiding unnecessary complexity.

• Demonstrate pride, ownership, and accountability for your work, expecting the same from your teammates.

REQUIREMENTS:

• Bachelor’s, Master’s, or Ph.D. degree in Computer Science, Engineering, Mathematics, or related field.

• 3+ years of work professional work experience in a fast-paced, high-growth environment.

• Extensive experience with Kubernetes.

• Experience in building and maintaining scalable infrastructure.

• Experience with infrastructure-as-code tools (e.g., Terraform, CloudFormation, Pulumi) and CI/CD tooling (e.g., GitHub Actions, GitLab CI, Circle CI, Jenkins).

• Relevant OSS observability experience (Prometheus, ELK stack, Grafana stack, Opentelemetry) is a plus.

• Ability to own projects end-to-end, from project specification to execution.

• No prior machine learning experience required, but should be open to learning about it.

BENEFITS:

• Competitive compensation package (Unlimited PTO, 401k, covered healthcare premiums).

• A unique opportunity to be part of a rapidly growing startup in one of the most exciting engineering fields of our era.

• An inclusive and supportive work culture that fosters learning and growth.

• Exposure to a variety of ML startups, offering unparalleled learning and networking opportunities.

At Baseten, we are committed to fostering a diverse and inclusive workplace. We provide equal employment opportunities to all employees and applicants without regard to race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, or veteran status.

Compensation

$150K – $250K Offers Equity

Competitive compensation. We aim to provide 90th percentile (or better) salaries and equity grants for every team member commensurate with their experience.