Principal DevOps Engineer (AI/ML Infrastructure)

Jobgether; Canada; Remote; CAD 130,000 - 165,000; Full time

Benefits offered by this job

Fully remote Canada

Competitive salary

Professional development

Long-term opportunity

Job summary

Jobgether is seeking a Principal DevOps Engineer (AI/ML Infrastructure) based in Canada to architect and lead scalable, secure AI/ML infrastructure within a SaaS platform.

You will drive automation, container orchestration, and production-grade pipelines, collaborating with researchers and engineers while mentoring the team. This fully remote role offers leadership impact and advanced cloud tooling exposure.

Qualifications

• 5+ years in DevOps, ML infra, or platform engineering with leadership.
• 5+ years on AWS/Azure/GCP and AI/ML services.
• Hands-on with Kubeflow/MLflow/SageMaker.
• 5-8+ years of Docker/Kubernetes for AI workloads.
• Programming in Python/Go/Bash with automation focus.
• Infrastructure-as-code with Terraform/Ansible.
• CI/CD pipelines with GitHub Actions/GitLab/Jenkins.
• Strong DevOps, security, and scalable infra knowledge.
• Excellent communication and collaboration across teams.

Responsibilities

• Architect and lead scalable, secure AI/ML infrastructure.
• Build and optimize CI/CD pipelines for AI/ML apps.
• Design cloud-based AI/ML infra using containers/orchestration.
• Automate provisioning, deployment, testing, and ops workflows.
• Collaborate with researchers, engineers, and data scientists.
• Ensure reliability, security, and performance of systems.
• Mentor junior engineers and promote best practices.

Skills

AWS / Azure / GCP

Leadership

CI/CD automation

Automation scripting

Security best practices

Communication

Mentoring

Tools

Kubeflow

MLflow

SageMaker

Docker

Kubernetes

GitHub Actions

GitLab CI/CD

Jenkins

Terraform

Ansible

Python

Go

Bash

Job description

This position is listed on behalf of a partner company, which manages all applications and next steps. Our partner is looking for a Principal DevOps Engineer (AI/ML Infrastructure) based in Canada

We are looking for an experienced Principal DevOps Engineer to design, build, and manage the infrastructure powering advanced AI and machine learning capabilities within a modern SaaS platform. In this senior technical role, you will drive the development of scalable, secure, and reliable AI/ML environments, supporting the entire lifecycle from experimentation and data ingestion to model deployment and production monitoring. You will work closely with AI researchers, software engineers, and cross-functional R&D teams to bridge the gap between research and production-ready solutions. Your expertise will help optimize infrastructure performance, automate complex workflows, and accelerate AI innovation. You will also serve as a technical leader and mentor, promoting engineering best practices and driving continuous improvement. This is an opportunity to contribute to impactful scientific software solutions within an international, innovation-driven environment.

Accountabilities

• Architect, design, and lead the implementation of scalable, secure, resilient, and high-performance infrastructure to support demanding AI and machine learning workloads.

• Build, maintain, and optimize specialized CI/CD pipelines for AI/ML applications, covering the complete lifecycle from data ingestion and model development to deployment, serving, and monitoring.

• Design and manage cloud-based AI/ML infrastructure, leveraging containerization, orchestration, and platform engineering technologies to ensure scalability and operational efficiency.

• Drive automation across infrastructure provisioning, model deployment, testing, and operational workflows to improve reliability, consistency, and development speed.

• Collaborate closely with AI researchers, data scientists, and software engineers to streamline experimentation processes and translate machine learning models into reliable production applications.

• Ensure the security, availability, reliability, and performance of AI/ML systems through effective infrastructure management, monitoring, and continuous optimization.

• Act as a technical subject matter expert, mentoring junior engineers and promoting best practices in AI/ML platform development, source control, automation, and deployment.

• Identify emerging technologies, tools, and industry trends, evaluating innovative solutions that can strengthen infrastructure capabilities and accelerate AI/ML development.

Requirements:

• At least 5 years of professional experience in DevOps, machine learning infrastructure, or platform engineering, including several years in a senior technical or leadership capacity.

• At least 5 years of advanced experience with one or more major cloud platforms, such as AWS, Microsoft Azure, or Google Cloud Platform (GCP), including their AI/ML and containerization services.

• Minimum 5 years of hands-on experience with machine learning orchestration and platform technologies such as Kubeflow, MLflow, or Amazon SageMaker.

• Approximately 5-8+ years of strong expertise in Docker and Kubernetes, particularly for deploying, managing, and scaling AI/ML workloads.

• Approximately 5-8+ years of programming experience with languages such as Python, Go, or Bash, with a strong focus on scripting and infrastructure automation.

• Experience with infrastructure-as-code and configuration management tools such as Terraform or Ansible.

• Demonstrated ability to design and implement reliable automated CI/CD pipelines using tools such as GitHub Actions, GitLab CI/CD, or Jenkins.

• Strong understanding of DevOps principles, cloud infrastructure, container orchestration, automation, scalability, and security best practices.

• Excellent communication and collaboration skills, with the ability to work effectively alongside AI researchers, software developers, infrastructure specialists, and business stakeholders.

• Strong technical problem-solving skills, initiative, and the ability to drive complex infrastructure projects independently.

• A valid LinkedIn profile and relevant professional work links must be included with your application.

• Must be based in Canada and available to work Eastern Standard Time (EST) business hours.

Benefits:

• Competitive annual base salary: CAD $130,000-$165,000, depending on experience, qualifications, work location, and internal compensation considerations.

• Fully remote opportunity: Work remotely from anywhere within Canada.

• Full-time position: Long-term opportunity in a newly created role.

• Technical leadership: Take ownership of strategic AI/ML infrastructure initiatives and influence platform engineering practices.

• Professional development: Work with modern cloud technologies, machine learning platforms, container orchestration, and advanced automation tools.

• Collaborative environment: Partner with experienced AI researchers, software engineers, and R&D professionals.

• Innovation and impact: Contribute to the development of AI-powered scientific software solutions supporting research, discovery, and innovation.

• Additional employee benefits may be available depending on the position and employment package offered.

How Jobgether works:

We use an AI-powered matching process to ensure your application is reviewed quickly, objectively, and fairly against the role's core requirements. Our system identifies the top-fitting candidates, and this shortlist is then shared directly with the hiring company. The final decision and next steps (interviews, assessments) are managed by their internal team.

We appreciate your interest and wish you the best!

Data Privacy Notice: By submitting your application, you acknowledge that Jobgether will process your personal data to evaluate your candidacy and share relevant information with the hiring employer. This processing is based on legitimate interest and pre-contractual measures under applicable data protection laws (including GDPR). You may exercise your rights (access, rectification, erasure, objection) at any time.