Staff MLOps Engineer

ZipRecruiter; Vancouver; On-site; CAD 150,000 - 240,000; Full time

Job summary

Une entreprise innovante dans le domaine de l'IA recherche un Ingénieur Plateforme pour construire et sécuriser son infrastructure cloud. Vous travaillerez en étroite collaboration avec les équipes d'ingénierie backend et ML pour déployer des services fiables et performants. Ce poste offre une opportunité unique de façonner l'avenir des expériences interactives en temps réel.

Qualifications

• 7+ ans d'expérience en ingénierie logicielle.
• 5 ans d'expérience avec infrastructure-as-code.
• Connaissance approfondie d'un fournisseur de cloud majeur.

Responsibilities

• Développer et gérer le cycle de vie des modèles ML en production.
• Gérer les pipelines CI/CD pour une intégration et un déploiement efficaces.
• Conduire des analyses des causes profondes pour identifier les problèmes critiques.

Skills

Kubernetes

CI/CD

Terraform

Python

Golang

Bash

SLURM

Tools

ArgoCD

GitHub Actions

Ansible

Job description

Job Description

Why Join Inworld

Inworld is the leading provider of AI technology for real-time interactive experiences, with a $500 million valuation and backing from top tier investors including Intel Capital, Microsoft’s M12 fund, Lightspeed Venture Partners, Section 32, BITKRAFT Ventures, Kleiner Perkins, Founders Fund, and First Spark Ventures.

Inworld provides the market’s best framework for building production ready interactive experiences, coupled with dedicated services to optimize specific stages of development – from design and development, to ML pipeline optimization and custom compute infrastructure. We help developers bring their AI engines in-house with a framework optimized for real-time data ingestion, low latency, and massive scale. Inworld powers experiences built by Ubisoft, NVIDIA, Niantic, NetEase Games and LG, among others, and has partnerships with key industry players such as Microsoft Xbox, Epic Games, and Unity.

Inworld was recognized by CB Insights as one of the 100 most promising AI companies in the world in 2024 and was named among LinkedIn’s Top Startups of 2024 in the USA.

Join our dynamic team as a Platform Engineer and play a pivotal role in building, securing, and scaling our cutting-edge AI engine for games. Collaborate with backend and ML engineers to plan, deploy, and maintain services across major cloud providers using Terraform, ArgoCD and other tooling. As part of our small, collaborative team, your contributions will significantly shape our operations and innovation.

About the role

As a Staff Platform Engineer (MLOps), you'll work closely with backend and ML Engineering teams to design, deploy, and maintain reliable, high-performance, and secure cloud infrastructure for our AI Engine and Studio.

What you’ll do

• Develop, manage, and optimize the ML model lifecycle in production using the Inworld AI platform and Nvidia CUDA, implementing CI/CD systems for ML workflows, monitoring models to identify issues and inefficiencies, and designing MLOps tools and frameworks to enhance automation and efficiency.
• Facilitate a "you build it, you run it" culture by providing the necessary tools and processes for monitoring the reliability, availability, and performance of services.
• Manage CI/CD pipelines to ensure smooth and efficient code integration and deployment.
• Identify and implement opportunities to enhance engineering speed and efficiency.
• Conduct root cause analysis to identify critical issues and develop automated solutions to prevent recurrence.
• Develop and share best practices to improve automation and efficiency across our engineering teams.

Requirements

• 7+ years of experience in software engineering.
• 5 years of experience with infrastructure-as-code.
• Proficiency in managing Kubernetes clusters and applications, including creating Helm charts/Kustomize manifests for new applications.
• Experience in creating and maintaining CI/CD pipelines for both applications and infrastructure deployments (using tools like Terraform/Terragrunt, ArgoCD, GitHub Actions, Ansible, etc.).
• Deep knowledge of at least one major cloud provider (Google Cloud Platform, Microsoft Azure, Oracle Cloud).
• Proficient in at least one backend programming/scripting such as Golang, Python, and Bash.
• Familiarity with open source LLM and open source serving solution (e.g. vLLM or llama.cpp, kserve, etc) is a plus.
• Experience with SLURM
• Experience with data pipeline and workflow management tools
• Experience with bare metal GPUs (optional)

The base salary range for this full-time position is CAD $150,000 - $240,000. In addition to base pay, total compensation includes equity and benefits. Within the range, individual pay is determined by work location, level, and additional factors, including competencies, experience, and business needs. The base pay range is subject to change and may be modified in the future.