AI Infrastructure Engineer

Mission.dev; Montreal; Remote; CAD 150,000 - 230,000; Full time

Benefits offered by this job

Founding equity

Direct ownership

Job summary

Mission.dev is hiring a founding Senior AI Infrastructure Engineer to design and operate large-scale AI infrastructures across public cloud and on-prem environments.

You will work as an individual contributor reporting to the CTO, blending software engineering with deep systems expertise to support massive concurrent users while maintaining high performance.

Qualifications

• Bachelor's degree or higher in CS or related technical field.
• 5+ years in AI infrastructure or systems engineering.
• Proven track record shipping LLM serving systems in production.

Responsibilities

• Design multi-cloud and on-premises infrastructure for AI workloads.
• Orchestrate large-scale deployments using IaC and containers.
• Benchmark AI inference workloads and optimize hardware utilization.
• Develop and maintain monitoring for high service quality and reliability.
• Collaborate with customers to deploy optimization solutions.
• Build and maintain an internal lab for testing and experimentation.

Skills

Python

Kubernetes

Terraform

Distributed systems

LLM serving

APIs

Education

Bachelor's degree in Computer Science or related field

Tools

Kubernetes

Helm

Ansible

Terraform

Job description

Employment type: Full-time position, 40 hours per week, with direct employment by the client.

Location: Remote-first role for candidates based in Canada.

Travel requirement: Candidates must be available to visit the client’s office in Montreal approximately two to three times per quarter.

Our company description

Mission.dev is the next-gen staffing platform for software talent.

We help you find, evaluate, and manage top software talent (contractors or direct hires) faster, smarter, and more efficiently.

Powered by AI. Backed by real humans.

About the client

An AI infrastructure company specializing in inference optimization for large-scale models.

The platform enhances token throughput and reduces latency by optimizing hardware utilization and decoding processes within a customer's cloud environment.

The technology focuses on improving the efficiency of model serving without requiring changes to existing infrastructure or code, ensuring data privacy while reducing operational costs for organizations deploying open-source models.

About the Role

As a founding Senior AI Infrastructure Engineer, you will report to the Chief Technology Officer to design and operate large-scale infrastructure for AI workloads on public cloud and on-premises environments. You will be an individual contributor with significant influence, combining software engineering with deep systems expertise to build secure and reliable platforms. Your work will focus on enabling efficient model serving at scale, ensuring the infrastructure can support a massive number of concurrent users while maintaining high service quality and performance.

What You’ll Do

• Design and manage multi-cloud and on-premises infrastructure for internal and external workloads.
• Orchestrate large-scale deployments using infrastructure-as-code and container orchestration to support high user concurrency.
• Benchmark AI inference workloads to identify performance bottlenecks and optimize hardware utilization.
• Develop and maintain comprehensive monitoring systems to ensure high service quality and reliability.
• Collaborate with customers to deploy and integrate optimization solutions within their existing infrastructure.
• Build and maintain an internal laboratory for infrastructure testing and experimentation.

What You Bring

• 5+ years of experience in AI infrastructure or systems engineering.
• Proficiency in Python and experience building and operating scalable APIs.
• Extensive experience with Kubernetes, Helm, Ansible, and Terraform.
• Proven track record of shipping large language model (LLM) serving systems in production environments.
• Experience with distributed computing frameworks such as Ray, RayClusters, or KubeRay.
• Demonstrated experience with agentic workflows.
• Bachelor’s degree in Computer Science or a related technical field.
• Founding-engineer equity and direct ownership.
• Remote-friendly work environment. Visit the office 2-3x a quarter in Montreal.
• Access to extensive compute resources and specialized hardware for experimentation.