ML Inference Platform Engineer (Kubernetes)

Baseten; New York (NY); On-site; USD 165,000 - 330,000; Full time

Benefits offered by this job

Competitive compensation, including equity

100% coverage of medical, dental, and vision insurance

Generous PTO policy

Paid parental leave

Company-facilitated 401(k)

Job summary

A leading AI company in New York is seeking an Infrastructure Software Engineer to develop and maintain components of their ML inference platform. Responsibilities include implementing Kubernetes deployments, enhancing monitoring systems, and developing infrastructure components using Python and Go. The ideal candidate should have a bachelor's degree in Computer Science, coding proficiency, and a working knowledge of Kubernetes. The role offers competitive compensation ranging from $165K to $330K and generous benefits including medical, dental, and vision insurance.

Qualifications

• Bachelor’s degree or higher in Computer Science or related field.
• Proficient coding abilities in one or more popular programming or scripting languages.
• Working knowledge of Kubernetes and containerization.
• Basic understanding of machine learning concepts and model serving.
• Familiarity with distributed systems concepts.

Responsibilities

• Develop infrastructure components for our ML inference platform using Python and Go.
• Implement and maintain Kubernetes deployments for model serving.
• Contribute to our inference orchestration layer for model deployments.
• Build and enhance monitoring systems for model performance metrics.
• Support infrastructure automation to improve ML deployment workflows.

Skills

Proficient coding abilities

Knowledge of Kubernetes

Interest in ML/AI infrastructure

Strong collaboration skills

Education

Bachelor’s degree in Computer Science or related field

Tools

Monitoring and logging tools

Job description

A leading AI company in New York is seeking an Infrastructure Software Engineer to develop and maintain components of their ML inference platform. Responsibilities include implementing Kubernetes deployments, enhancing monitoring systems, and developing infrastructure components using Python and Go. The ideal candidate should have a bachelor's degree in Computer Science, coding proficiency, and a working knowledge of Kubernetes. The role offers competitive compensation ranging from $165K to $330K and generous benefits including medical, dental, and vision insurance.