Platform Engineer I - Machine Learning Infrastructure

Spotify; Toronto; Hybrid; CAD 80,000 - 110,000; Full time

Job summary

A leading company is seeking a Machine Learning Infrastructure Engineer to develop and maintain a robust ML platform. The role involves managing Kubernetes clusters, collaborating with teams, and implementing scalable solutions. Flexibility for remote work is offered, with some in-person meetings required.

Qualifications

• 1+ years of hands-on experience implementing production ML infrastructure.
• Knowledge of deep learning fundamentals and algorithms.

Responsibilities

• Manage and maintain large scale production Kubernetes clusters for ML workloads.
• Collaborate with Machine Learning Engineers and product teams for scalable solutions.

Skills

Python

Go

Agile Software Processes

Tools

Huggingface

Ray

PyTorch

TensorFlow

Job description

The Hendrix ML Platform team is dedicated to developing a robust, Spotify-wide platform for training and serving machine learning models. This platform streamlines the productionization of AI and ML models by mitigating the incidental complexities involved in creating backend services for serving predictions and training models.

What You'll Do

• Manage and maintain large scale production Kubernetes clusters for ML workloads, including ML platform infrastructure and necessary dev ops.
• Contribute to Spotify ML Platform SDK and build tools for various ML operations.
• Collaborate with Machine Learning Engineers (MLE), researchers, and various product teams to deliver scalable ML platform tooling solutions that meet the timelines and specifications of given requirements.
• Work independently and collaboratively on squad projects that often requires learning and applying new technologies that may go beyond existing skillsets.
• Designs, documents and implements reliable, testable and maintainable solutions ML infrastructure capabilities.

Who You Are

• You have 1+ years of hands-on experience implementing production ML infrastructure at scale in Python, Go or similar languages
• Knowledge of deep learning fundamentals, algorithms, and open-source tools such as Huggingface, Ray, PyTorch or TensorFlow
• Contributed to a production ML Model or ML infrastructure
• You have a general understanding of data processing for ML
• You have experience with agile software processes and modular code design following industry standards

Where You'll Be

• This role is based in Toronto.
• We offer you the flexibility to work where you work best! There will be some in person meetings, but still allows for flexibility to work from home.