ML Inference Infrastructure Engineer

Baseten; San Francisco (CA); On-site; USD 90,000 - 130,000; Full time

Benefits offered by this job

100% coverage of medical, dental, and vision insurance

Generous PTO policy including Winter Break

Company-facilitated 401(k)

Job summary

A dynamic AI company is seeking an Infrastructure Software Engineer in San Francisco to build and maintain components of an ML inference platform. The successful candidate will develop infrastructure components using Python and Go, manage Kubernetes deployments, and enhance monitoring systems for model metrics. This role offers competitive compensation with benefits like 100% medical coverage and generous PTO policies. Join a collaborative team dedicated to advancing AI and machine learning infrastructure.

Qualifications

• 1-3 years experience in software engineering or infrastructure.
• Working knowledge of Kubernetes and containerization.
• Basic understanding of machine learning concepts.

Responsibilities

• Develop infrastructure components for our ML inference platform using Python and Go.
• Implement and maintain Kubernetes deployments for model serving.
• Support infrastructure automation to improve ML deployment workflows.

Skills

Proficient coding abilities

Collaboration and communication skills

Interest in ML/AI infrastructure

Education

Bachelor's degree or higher in Computer Science or related field

Tools

Kubernetes

Go

Monitoring tools

Job description

A dynamic AI company is seeking an Infrastructure Software Engineer in San Francisco to build and maintain components of an ML inference platform. The successful candidate will develop infrastructure components using Python and Go, manage Kubernetes deployments, and enhance monitoring systems for model metrics. This role offers competitive compensation with benefits like 100% medical coverage and generous PTO policies. Join a collaborative team dedicated to advancing AI and machine learning infrastructure.