ML Inference Infrastructure Engineer

Baseten; United States; À distance; USD 120 000 - 190 000; Plein temps

Avantages offerts par ce poste

Equity

Medical coverage for employee and dep.

Flexible PTO including Winter Break

Parental leave

Fertility stipend

401(k)

Résumé du poste

Baseten is seeking an Infrastructure Software Engineer in the United States to build and maintain components of our ML inference platform. You will enable developers to deploy, scale, and monitor models with high performance.

You will work with Python and Go, manage Kubernetes deployments, and contribute to our inference orchestration layer while improving monitoring and resource management for ML workloads.

Qualifications

• Bachelor's degree in Computer Science or related field.
• Proficient in Go and Python; Kubernetes experience is a plus.
• Familiar with distributed systems and ML infrastructure concepts.

Responsabilités

• Develop infrastructure components for ML inference platform using Python and Go.
• Manage Kubernetes deployments for model serving and monitoring.
• Contribute to the inference orchestration layer for model deployments.
• Build and enhance monitoring systems for model performance metrics.
• Implement efficient resource management for ML workloads and automate deployments.
• Collaborate with team to implement infrastructure improvements and balance performance with reliability.

Connaissances

Python

Go

Distributed systems

Formation

Bachelor's degree in CS or related field

Outils

Kubernetes

Description du poste

Baseten is seeking an Infrastructure Software Engineer in the United States to build and maintain components of our ML inference platform. You will enable developers to deploy, scale, and monitor models with high performance.

You will work with Python and Go, manage Kubernetes deployments, and contribute to our inference orchestration layer while improving monitoring and resource management for ML workloads.