Senior MLOps Engineer

Jobgether; United States; Remote; CAD 150,000 - 200,000; Full time

Benefits offered by this job

Remote work

Job summary

Jobgether, on behalf of a partner company, seeks a Senior MLOps Engineer based in Canada to design, build, and scale machine learning infrastructure for AI-powered government services. As the first MLOps specialist on the team, you will establish foundations for moving models from research to production, implement CI/CD for ML, monitor models, and optimize cost and performance across cloud platforms.

This role offers strong ownership, collaboration with researchers and software engineers, remote

Qualifications

• 6–10+ years of software or ML engineering experience.
• At least 3 years focused on MLOps or ML infrastructure.
• Proficiency deploying, operating, and maintaining ML models in production.
• Hands-on with Docker and Kubernetes for scalable ML systems.
• Cloud experience with AWS, GCP, or Azure including GPU workloads.
• Experience building CI/CD pipelines (GitHub Actions, Jenkins).
• Familiarity with ML experiment tracking tools (MLflow, Weights & Biases, Kubeflow).
• Strong data versioning, model reproducibility, and monitoring knowledge.
• Excellent problem-solving and cross-team collaboration skills.
• Experience training models from scratch and production monitoring is a plus.

Responsibilities

• Design, develop, and maintain end-to-end ML pipelines (training, evaluation, deployment).
• Build and optimize infrastructure for training and serving ML workloads across clouds.
• Develop tools for data pipelines, labeling, experiment tracking, and retraining.
• Collaborate with researchers and engineers to productionize PoCs.
• Implement CI/CD practices for ML systems and deployments.
• Monitor production models for performance, data quality, and drift.
• Streamline infra provisioning and improve data access reliability.
• Optimize costs and performance for large-scale training/inference.
• Document standards and best practices for MLOps workflows.
• Contribute to scalable and maintainable AI systems.

Skills

Python

C

C++

Bash

Docker

Kubernetes

GitHub Actions

Jenkins

Terraform

CI/CD

MLflow

Weights & Biases

Tools

Docker

Kubernetes

GitHub Actions

Jenkins

Terraform

Job description

This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Senior MLOps Engineer based in Canada.

The Senior MLOps Engineer will design, build, and scale the machine learning infrastructure that powers AI-driven solutions for modernizing government services. As the first MLOps specialist on the team, you will establish the foundations for moving machine learning models and agentic AI workflows from research and experimentation into reliable production environments. This role combines software engineering, machine learning operations, and cloud infrastructure to deliver scalable, secure, and high-performing AI capabilities. You will collaborate closely with AI researchers, ML engineers, and software engineering teams to improve deployment workflows, reproducibility, observability, and operational efficiency. The position offers significant technical ownership and the opportunity to shape MLOps standards, tools, and best practices from the ground up. It is well suited to an experienced engineer who enjoys solving complex infrastructure challenges and enabling teams to deliver impactful AI systems at scale.

Accountabilities

• Design, develop, and maintain end-to-end machine learning pipelines for model training, evaluation, deployment, and agentic AI workflows.
• Build and optimize infrastructure for model training and serving across cloud platforms and compute environments, including GPU-based workloads.
• Develop and maintain tools supporting data pipelines, data labeling, experiment tracking, model performance measurement, and automated retraining.
• Collaborate with AI researchers and machine learning engineers to transition proof-of-concept solutions into production-ready systems that are reproducible, reliable, and scalable.
• Implement and improve CI/CD practices for machine learning systems, including continuous integration, automated testing, and deployment workflows.
• Monitor production models for performance, health, data quality, and model drift, implementing appropriate observability and monitoring strategies.
• Partner with engineering teams to streamline infrastructure provisioning, improve data access, and strengthen the reliability of shared technical systems.
• Optimize infrastructure costs and system performance for large-scale model training and inference workloads.
• Establish and maintain documentation, technical standards, and best practices for MLOps workflows and infrastructure management.
• Contribute to the development of scalable, maintainable, and efficient systems that enable AI capabilities to be delivered safely and consistently.

Requirements

• 6–10+ years of experience in software engineering or machine learning engineering, including at least 3 years focused on MLOps or machine learning infrastructure.
• Strong programming skills in Python and experience with languages and scripting tools such as C, C++, and Bash.
• Demonstrated experience deploying, operating, and maintaining machine learning models in production environments.
• Proficiency with Docker and Kubernetes for containerization and scalable machine learning system design.
• Hands-on experience with cloud platforms such as AWS, Google Cloud Platform, or Microsoft Azure, including GPU orchestration.
• Experience designing, implementing, and maintaining CI/CD pipelines using tools such as GitHub Actions, Jenkins, or equivalent platforms.
• Familiarity with machine learning experiment tracking and pipeline automation tools, such as MLflow, Weights & Biases, and Kubeflow.
• Strong understanding of data versioning, model reproducibility, production monitoring, and model lifecycle management.
• Excellent analytical and problem-solving skills, with the ability to diagnose complex technical issues and develop effective solutions.
• Strong collaboration and communication skills, with the ability to work effectively across research, machine learning, and software engineering teams.
• Experience training models from scratch, including architecture selection, dataset curation and cleaning, training parameter tuning, and production monitoring, is an asset.
• Familiarity with model optimization techniques such as quantization, distillation, TensorRT, and ONNX is an advantage.
• Experience with infrastructure-as-code tools such as Terraform or CloudFormation is beneficial.
• A background in distributed systems or high-performance computing is a plus.
• Contributions to open-source projects are considered an asset.
• Willingness to undergo comprehensive background checks and participate in occasional in-person company or departmental meetings, typically once or twice per year.

Benefits

• Competitive base salary ranging from CAD $150,000 to $200,000, depending on skills, experience, qualifications, internal pay equity, and compensation philosophy.
• Competitive compensation packages designed to recognize employees' contributions and expertise.
• Paid time off to support rest, personal commitments, and work-life balance.
• Benefits intended to support employees' health and the well-being of their families, subject to employment type and applicable eligibility conditions.
• Remote work environment offering flexibility and opportunities to collaborate with distributed teams.
• Significant technical ownership as the first MLOps Engineer, with the opportunity to establish foundational infrastructure, standards, and practices.
• Opportunities for continuous learning, professional development, and technical growth.
• A collaborative culture that encourages ownership, a growth mindset, open and respectful communication, and customer-focused decision-making.
• An inclusive workplace that welcomes candidates from diverse backgrounds and values different perspectives and experiences.
• Reasonable accommodations throughout the application, interview, and pre-employment assessment processes.
• Occasional travel for in-person company-wide or departmental meetings, generally one to two times per year.
• Please note that benefits may vary depending on employment type, including full-time, part-time, or contract arrangements.

How Jobgether Works

We use an AI-powered matching process to ensure your application is reviewed quickly, objectively, and fairly against the role's core requirements. Our system identifies the top-fitting candidates, and this shortlist is then shared directly with the hiring company. The final decision and next steps (interviews, assessments) are managed by their internal team.

We appreciate your interest and wish you the best!

Why Apply Through Jobgether?

Data Privacy Notice:

By submitting your application, you acknowledge that Jobgether will process your personal data to evaluate your candidacy and share relevant information with the hiring employer. This processing is based on legitimate interest and pre-contractual measures under applicable data protection laws (including GDPR). You may exercise your rights (access, rectification, erasure, objection) at any time.

We may use artificial intelligence (AI) tools to support parts of the hiring process, such as reviewing applications, analyzing resumes, or assessing responses and identifying potential inconsistencies or verification signals in application materials based on available information. These tools assist our recruitment team but do not replace human judgment. Final hiring decisions are ultimately made by humans. If you would like more information about how your data is processed, please contact us.