ML Inference Platform Engineer (Kubernetes, Go)

Baseten; Seattle (WA); On-site; USD 165,000 - 330,000; Full time

Benefits offered by this job

Competitive equity + compensation

Healthcare coverage for employee and 1

Flexible PTO including Winter Break

Paid parental leave

Fertility and family-building stipend

Company 401(k) (US)

Exposure to ML startups

Job summary

Baseten is hiring an Infrastructure Software Engineer to build and maintain components of our ML inference platform that powers production AI applications. You"ll help developers deploy, scale, and monitor models with high performance.

Join a team working on multi-cloud capacity management, GPU-based inference, and efficient model serving, with a strong emphasis on reliability and collaboration.

Qualifications

• Bachelor's degree or higher in Computer Science or related field.
• Proficient coding abilities in one or more popular programming or scripting languages; Go proficiency is a plus.
• Working knowledge of Kubernetes and containerization.
• Basic understanding of machine learning concepts and model serving.
• Familiarity with distributed systems concepts.
• Experience with basic monitoring and logging tools.
• Strong collaboration and communication skills.

Responsibilities

• Develop infrastructure components for our ML inference platform using Python and Go.
• Implement and maintain Kubernetes deployments for model serving.
• Contribute to our inference orchestration layer for model deployments.
• Build and enhance monitoring systems for model performance metrics.
• Implement efficient resource management solutions for ML workloads.
• Support infrastructure automation to improve ML deployment workflows.
• Work closely with team members to implement technical solutions.
• Help balance performance optimization with system reliability.
• Participate in technical discussions around infrastructure improvements.
• Learn and apply infrastructure best practices.

Skills

Go

Python

Distributed systems

Monitoring/logging

Collaboration

Communication

ML concepts

Education

Bachelor's degree in Computer Science or related field

Tools

Kubernetes

Containerization

Job description

Baseten is hiring an Infrastructure Software Engineer to build and maintain components of our ML inference platform that powers production AI applications. You"ll help developers deploy, scale, and monitor models with high performance.

Join a team working on multi-cloud capacity management, GPU-based inference, and efficient model serving, with a strong emphasis on reliability and collaboration.