Senior ML Infrastructure Engineer

Ellison Institute of Technology; Town of Oxford; On-site; CAD 110,000 - 170,000; Full time

Benefits offered by this job

Enhanced holiday pay

Pension

Life Assurance

Income Protection

Private Medical Insurance

Hospital Cash Plan

Therapy Services

Perk Box

Electric Car Scheme

Job summary

A leading technology institute in Nova Scotia, Canada, seeks an experienced professional to join its MLOps team. You will design and optimize high-performance ML compute clusters to facilitate scientific breakthroughs. The role requires proven experience in managing ML infrastructure, accommodating performance profiling, and enhancing efficiency. The organization offers competitive benefits including enhanced holiday pay, a pension scheme, and private medical insurance. Join a collaborative team that values emotional intelligence and encourages innovative thinking.

Qualifications

• Proven experience leading the design, build, and operation of high-performance ML compute clusters at scale.
• A proactive, autonomous approach to systems design and ability to implement optimal solutions.
• Exposure to migrating ML infrastructure to modern, containerized systems.
• Expertise with high-throughput storage systems for ML/HPC workloads.
• Strong understanding of GPU architecture and high-speed networking for distributed training.
• Solid grasp of AI/CI/CD practices (Terraform, Argo CD).

Responsibilities

• Build, operate, and continuously optimize high-performance GPU training and inference clusters.
• Drive systems design and implementation for high-throughput data paths.
• Benchmark, profile, and resolve performance bottlenecks across layers.
• Establish observability, resilience, and automated security controls for sensitive research environments.
• Forecast capacity and cost for GPU and storage needs with researchers and engineering teams.

Skills

High-performance ML compute cluster design

Systems design and implementation

Performance profiling

High-throughput storage systems

Expert-level understanding of GPU architecture

Infrastructure as Code and CI/CD practices

Argo CD

GPU Architecture

Tools

Terraform

Argo CD

Lustre storage

Job description

At the Ellison Institute of Technology (EIT), we’re on a mission to translate scientific discovery into real world impact. We bring together visionary scientists, technologists, policy makers, and entrepreneurs to tackle humanity’s greatest challenges in four transformative areas:

• Health, Medical Science & Generative Biology
• Food Security & Sustainable Agriculture
• Climate Change & Managing CO₂
• Artificial Intelligence & Robotics

This is ambitious work - work that demands curiosity, courage, and a relentless drive to make a difference. At EIT, you’ll join a community built on excellence, innovation, tenacity, trust, and collaboration, where bold ideas become real-world breakthroughs. Together, we push boundaries, embrace complexity, and create solutions to scale ideas for lab to society. Explore more at www.eit.org

Our MLOps team

Join ourMLOpsteam to build the cloud and compute foundation that enables scientific breakthroughs. Deliver reliable, secure platforms and self-service guardrails that accelerate experimentation and turn ideas into results—faster, at scale, and with confidence.

Day-to-day, you might:

• Build,operate, and continuously optimise our high-performance GPU training and inference clusters, focusing on robust, high-availability scheduling, isolation, and automated lifecycle management.
• Drive systems design and implementation for high-throughput data paths, optimising I/O, caching, and data locality across compute and storage (including our current Lustre implementation).
• Proactively benchmark, profile, and resolve performance bottlenecks across the compute, network, and orchestration layers to maximise efficiency for distributed training and inference.
• Establish comprehensive observability, resilience, and automated security controls to ensure compliance and robust operation of sensitive research environments.
• Partner with Research, Data, and Applied teams to forecast capacity and cost for GPU and storage needs, setting quotas and streamlining ML experimentation pipelines.

What makes you a great fit:

• Proven experience leading the design, build, and operation of high-performance ML compute clusters at scale
• A proactive, autonomous approach to systems design and the proven ability and desire to ideate, co-create and implementoptimalsolutions
• Exposure to migrating or transforming ML infrastructure from traditional schedulers to modern, containerised systems
• Expertisewith high-throughput storage systems for ML/HPC workloads
• Expert-level understanding of GPU architecture, high-speed networking for distributed training, and performance profiling to resolve bottlenecks
• A solid grasp ofIaCand CI/CD practices (e.g., Terraform, Argo CD)

We offer the following salary and benefits:

Enhanced holiday pay

Pension

Life Assurance

Income Protection

Private Medical Insurance

Hospital Cash Plan

Therapy Services

Perk Box

Electric Car Scheme

Why work for EIT:

At the Ellison Institute, we believe a collaborative, inclusive team is key to our success. We are building a supportive environment where creative risks are encouraged, and everyone feels heard. Valuing emotional intelligence, empathy, respect, and resilience, we encourage people to be curious and to have a shared commitment to excellence. Join us and make an impact!