AI Infrastructure Engineer

Mission

Montreal

Hybrid

CAD 140,000 - 200,000

Full time

22 hours ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Mission.dev is recruiting a founding Senior AI Infrastructure Engineer for a Montreal-based client specializing in AI inference optimization. You will design and operate large-scale infrastructure for AI workloads across public cloud and on-prem environments, reporting to the CTO.

As an individual contributor with influence, you will enable scalable model serving, implement IaC and container orchestration, and collaborate with customers to deploy optimization solutions while ensuring data

Qualifications

  • 5+ years in AI infrastructure or systems engineering.
  • Bachelor’s degree in Computer Science or related field required.

Responsibilities

  • Design and manage multi-cloud and on-premises infrastructure for internal and external workloads.
  • Orchestrate large-scale deployments using infrastructure-as-code and container orchestration to support high user concurrency.
  • Benchmark AI inference workloads to identify performance bottlenecks and optimize hardware utilization.
  • Develop and maintain monitoring systems to ensure high service quality and reliability.
  • Collaborate with customers to deploy optimization solutions within their existing infrastructure.
  • Build and maintain an internal laboratory for infrastructure testing and experimentation.

Skills

Python
LLM serving
Multi-cloud
APIs

Education

Bachelor’s degree in Computer Science or related

Tools

Kubernetes
Helm
Ansible
Terraform
Ray

Job description

Employment type: Full-time position, 40 hours per week, with direct employment by the client.

Hybrid: Candidates must be able to work at the client’s Montreal office.

Our company description

Mission.dev is the next-gen staffing platform for software talent.

We help you find, evaluate, and manage top software talent (contractors or direct hires) faster, smarter, and more efficiently.

Powered by AI. Backed by real humans.

About the client

An AI infrastructure company specializing in inference optimization for large-scale models.

The platform enhances token throughput and reduces latency by optimizing hardware utilization and decoding processes within a customer's cloud environment.

The technology focuses on improving the efficiency of model serving without requiring changes to existing infrastructure or code, ensuring data privacy while reducing operational costs for organizations deploying open-source models.

About the Role

As a founding Senior AI Infrastructure Engineer, you will report to the Chief Technology Officer to design and operate large-scale infrastructure for AI workloads on public cloud and on-premises environments. You will be an individual contributor with significant influence, combining software engineering with deep systems expertise to build secure and reliable platforms. Your work will focus on enabling efficient model serving at scale, ensuring the infrastructure can support a massive number of concurrent users while maintaining high service quality and performance.

What You’ll Do
  • Design and manage multi-cloud and on-premises infrastructure for internal and external workloads.
  • Orchestrate large-scale deployments using infrastructure-as-code and container orchestration to support high user concurrency.
  • Benchmark AI inference workloads to identify performance bottlenecks and optimize hardware utilization.
  • Develop and maintain comprehensive monitoring systems to ensure high service quality and reliability.
  • Collaborate with customers to deploy and integrate optimization solutions within their existing infrastructure.
  • Build and maintain an internal laboratory for infrastructure testing and experimentation.
What You Bring
  • 5+ years of experience in AI infrastructure or systems engineering.
  • Proficiency in Python and experience building and operating scalable APIs.
  • Extensive experience with Kubernetes, Helm, Ansible, and Terraform.
  • Proven track record of shipping large language model (LLM) serving systems in production environments.
  • Experience with distributed computing frameworks such as Ray, RayClusters, or KubeRay.
  • Demonstrated experience with agentic workflows.
  • Bachelor’s degree in Computer Science or a related technical field.
  • Founding‑engineer equity and direct ownership.
  • Access to extensive compute resources and specialized hardware for experimentation.
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Founding Senior AI Infra Engineer — Multi-Cloud Equity
Founding Senior AI Infra Engineer — Multi-Cloud Equity

Mission • Montreal

Hybrid
CAD 140,000 - 200,000
Senior LLMOps Engineer -Cloud / AI Infrastructure
Senior LLMOps Engineer -Cloud / AI Infrastructure

Talent To Hire Inc. • Toronto

Hybrid
CAD 120,000 - 160,000
Competitive salary
Meaningful equity
Innovative work culture
AI Infrastructure Engineer
AI Infrastructure Engineer

Delos Data • Cambridge

On-site
CAD 217,000 - 254,000
AI Engineer
AI Engineer

Triunity Software, Inc. • Quebec

On-site
CAD 90,000 - 130,000
Bonus based on performance
Health insurance
Training & development
Software Engineer, Data Infrastructure
Software Engineer, Data Infrastructure

Cohere • Montreal

Hybrid
CAD 90,000 - 120,000
Open and inclusive culture
Weekly lunch stipend and snacks
Full health and dental benefits
+4
AI Developer
AI Developer

Vooban • Quebec

Hybrid
CAD 90,000 - 120,000
Forward Deployed Engineer
Forward Deployed Engineer

Robots & Pencils LP • Canada

On-site
CAD 176,612 - 243,680
AI/ML Infrastructure Engineer
AI/ML Infrastructure Engineer

BULL-IT SOLUTIONS LTD • Montreal

On-site
CAD 100,000 - 130,000
Forward Deployed Engineer
Forward Deployed Engineer

robotsandpencils • Calgary

On-site
CAD 180,000 - 240,000
Principal DevOps Engineer (AI/ML Infrastructure)
Principal DevOps Engineer (AI/ML Infrastructure)

Jobgether • Canada

Remote
CAD 130,000 - 165,000
Fully remote Canada
Competitive salary
Professional development
+1