ML Inference Infrastructure Engineer

Baseten; United States; Remote; USD 120,000 - 190,000; Full time

Benefits offered by this job

Equity

Medical coverage for employee and dep.

Flexible PTO including Winter Break

Parental leave

Fertility stipend

401(k)

Job summary

Baseten is seeking an Infrastructure Software Engineer in the United States to build and maintain components of our ML inference platform. You will enable developers to deploy, scale, and monitor models with high performance.

You will work with Python and Go, manage Kubernetes deployments, and contribute to our inference orchestration layer while improving monitoring and resource management for ML workloads.

Qualifications

• Bachelor's degree in Computer Science or related field.
• Proficient in Go and Python; Kubernetes experience is a plus.
• Familiar with distributed systems and ML infrastructure concepts.

Responsibilities

• Develop infrastructure components for ML inference platform using Python and Go.
• Manage Kubernetes deployments for model serving and monitoring.
• Contribute to the inference orchestration layer for model deployments.
• Build and enhance monitoring systems for model performance metrics.
• Implement efficient resource management for ML workloads and automate deployments.
• Collaborate with team to implement infrastructure improvements and balance performance with reliability.

Skills

Python

Go

Distributed systems

Education

Bachelor's degree in CS or related field

Tools

Kubernetes

Job description

Baseten is seeking an Infrastructure Software Engineer in the United States to build and maintain components of our ML inference platform. You will enable developers to deploy, scale, and monitor models with high performance.

You will work with Python and Go, manage Kubernetes deployments, and contribute to our inference orchestration layer while improving monitoring and resource management for ML workloads.