Scale AI Infra Engineer | Kubernetes & CI/CD

BaseTen; New York, San Francisco (NY, CA); Hybrid; USD 160,000 - 210,000; Full time

Benefits offered by this job

Meaningful equity

100% medical, dental, vision coverage

Flexible PTO including Winter Break

Paid parental leave

Fertility and family-building stipend

Company-facilitated 401(k)

Exposure to ML startups

Job summary

Baseten is seeking a Cloud Platform Engineer to design and build scalable infrastructure for deploying ML models. You’ll automate deployments, monitor systems, and optimize performance while working closely with product teams and users to turn feedback into reliable tooling.

You’ll own projects end-to-end, collaborate across squads, and mentor juniors, while adopting best practices for reliability and efficiency. This role offers learning opportunities in ML ops at a fast-growing startup.

Qualifications

• Bachelor’s, Master’s, or Ph.D. in Computer Science, Engineering, Mathematics, or related field.
• Extensive experience with Kubernetes.
• Experience in building and maintaining scalable infrastructure.
• Experience with infrastructure-as-code tools (Terraform, CloudFormation, Pulumi) and CI/CD tooling (GitHub Actions, GitLab CI, CircleCI, Jenkins).
• OSS observability experience (Prometheus, ELK, Grafana, OpenTelemetry) is a plus.
• Ability to own projects end-to-end, from specification to execution.
• No prior ML experience required, but willingness to learn.

Responsibilities

• Build and maintain scalable infrastructure to support deployment and operation of ML models.
• Establish standards for reliability and performance across the infrastructure.
• Automate processes, especially CI/CD pipelines.
• Own products and projects end-to-end with user empathy and project execution.
• Collaborate with cross-functional teams to translate requirements into solutions.
• Mentor junior team members and share knowledge within the org.
• Navigate ambiguity and make sound tradeoffs with the right tools.
• Demonstrate pride, ownership, and accountability in work.

Skills

End-to-end ownership

Project management

Mentoring

Collaboration

Learning mindset

Education

Bachelor's, Master’s, or Ph.D. in Computer Science, Engineering, Mathematics, or related field

Tools

Kubernetes

Terraform

CloudFormation

Pulumi

GitHub Actions

GitLab CI

CircleCI

Jenkins

Prometheus

ELK stack

Grafana

OpenTelemetry

Job description

Baseten is seeking a Cloud Platform Engineer to design and build scalable infrastructure for deploying ML models. You’ll automate deployments, monitor systems, and optimize performance while working closely with product teams and users to turn feedback into reliable tooling.

You’ll own projects end-to-end, collaborate across squads, and mentor juniors, while adopting best practices for reliability and efficiency. This role offers learning opportunities in ML ops at a fast-growing startup.