Senior LLMOps Engineer -Cloud / AI Infrastructure

Talent To Hire Inc.

Toronto

Hybrid

CAD 120,000 - 160,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Competitive salary
Meaningful equity
Innovative work culture

Job summary

A rapid-growth technology firm in Toronto is seeking a Staff LLMOps Engineer to lead the design and optimization of large language model infrastructure on the cloud. The ideal candidate has over 6 years of experience in DevOps and expertise in deploying LLMs in cloud environments. Responsibilities include architecting deployment pipelines and ensuring high-performance AI applications. Competitive salary and equity are included in the offer.

Qualifications

  • 6+ years in DevOps or cloud platform engineering.
  • 2+ years of experience with LLMs deployment.
  • Expertise with GPU-accelerated inference.

Responsibilities

  • Architect and operationalize LLM deployment pipelines on AWS.
  • Build and scale multi-GPU inference infrastructure.
  • Optimize inference performance using various frameworks.

Skills

DevOps expertise
ML infrastructure knowledge
Cloud platform experience
Python proficiency
Monitoring tools integration

Tools

AWS
Kubernetes
Terraform
Prometheus
Grafana

Job description

Location: Downtown Toronto
Hybrid: 4 days in office

Ready to build what powers the next generation of AI?

We’re looking for a Staff LLMOps Engineer to lead the design, deployment, and optimization of large language model (LLM) infrastructure on the cloud.
You’ll be the driving force behind taking trained models from lab to production—scaling efficiently across multi-GPU clusters and pushing the boundaries of inference performance for enterprise-grade AI applications.

If you thrive at the intersection of AI, cloud engineering, and systems optimization, this is your chance to shape the future of large-scale model serving in a high-impact environment.

What You’ll Do

Architect and operationalize LLM deployment pipelines on AWS and Kubernetes/EKS.

Build and scale multi-GPU inference infrastructure for low latency, high availability, and cost efficiency.

Optimize inference using frameworks like vLLM, SGLang, and DeepSpeed-Inference.

Implement advanced serving techniques: continuous batching, speculative decoding, KV-cache management, and distributed scheduling.

Collaborate with AI researchers to convert model training outputs into production-grade APIs and services.

Establish observability and monitoring for latency, throughput, GPU utilization, and failure recovery.

Automate provisioning, scaling, and upgrades using Terraform and CI/CD pipelines.

Ensure compliance, security, and efficiency in multi-tenant LLM hosting for enterprise clients.

What We’re Looking For

6+ years in DevOps, ML infrastructure, or cloud platform engineering.

2+ years of direct experience deploying and optimizing LLMs or large-scale ML models.

Expertise with GPU-accelerated inference and distributed serving environments.

Deep familiarity with cloud-native architectures (AWS, GCP, Azure) and Kubernetes.

Strong foundation in Python, Bash, and IaC (Terraform).

Experience integrating monitoring tools (Prometheus, Grafana, Datadog) for performance visibility.

Passion for building robust, scalable, and secure AI systems.

Why Join

Lead and own mission-critical AI infrastructure at a fast-scaling startup.

Work alongside world-class engineers, data scientists, and innovators.

Competitive salary + meaningful equity in a company redefining applied AI.

A culture built on innovation, technical depth, and impact—your work truly matters.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Machine Learning Engineer
Senior Machine Learning Engineer

Encore Technical Solutions Inc. • Toronto

On-site
CAD 100,000 - 150,000
MLOps Developer
MLOps Developer

Quantum Technology Recruiting Inc. (QTR) • Toronto

Hybrid
CAD 140,000 - 171,000
Senior LLMOps Engineer — Cloud AI Inference + Equity
Senior LLMOps Engineer — Cloud AI Inference + Equity

TEEMA Solutions Group • Toronto

Hybrid
CAD 120,000 - 160,000
Competitive salary
Meaningful equity
Innovative work culture
Lead/Senior Inference Engineer
Lead/Senior Inference Engineer

Jobgether • Canada

Remote
CAD 140,000 - 175,000
Base salary CAD 140,000–175,000
Annual performance bonus potential
Flexible work arrangements
+4
AI Infrastructure Engineer
AI Infrastructure Engineer

Mission • Montreal

Hybrid
CAD 140,000 - 200,000
Senior AI Engineer
Senior AI Engineer

Astra-North Infoteck Inc. • Toronto

Hybrid
CAD 150,000 - 210,000
Senior MLOps & Cloud Engineer (AWS / SageMaker)
Senior MLOps & Cloud Engineer (AWS / SageMaker)

Randstad Digital • Toronto

Hybrid
CAD 117,000 - 143,000
Hybrid work model
Technical Architect
Technical Architect

Mphasis • Toronto

On-site
CAD 120,000 - 180,000
Senior AI Engineer (NVIDIA + LLM Inference) - Onsite - Toronto, Canada
Senior AI Engineer (NVIDIA + LLM Inference) - Onsite - Toronto, Canada

FullStack • Toronto

Hybrid
CAD 120,000 - 180,000
Competitive pay
Career growth
Education opportunities
AI/ML Engineer
AI/ML Engineer

JAVA Holdings Ltd. • Edmonton

On-site
CAD 110,000 - 150,000
Extended Healthcare Plan
Group RRSP
Group Life - AD&D - Critical Illness
+3