Senior AI Deployment & Inference Engineer

Coreweave

Municipality of Crowsnest Pass

On-site

CAD 120,000 - 180,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Medical, dental, vision insurance
Life Insurance
Retirement plan
Tuition Reimbursement
Employee Stock Purchase Program
Paid parental leave
Flexible PTO
Catered lunch

Job summary

CoreWeave is seeking a Senior Deployment Engineer to bring AI models into production, optimize performance, and integrate with enterprise systems. You will own technical delivery from discovery to adoption, working closely with customers and product/engineering teams.

Ideal candidates have 5+ years of hands-on experience in software/ML engineering, strong Python and ML framework skills, and expertise in deploying LLMs with model-serving tools. Excellent communication to customers is essential.

Qualifications

  • 5+ years in software/ML engineering or related hands-on role.
  • Strong Python and ML framework skills (PyTorch, Transformers).
  • Hands-on experience deploying and optimizing AI models in production (LLMs).
  • Experience with model-serving frameworks (vLLM, TensorRT-LLM).
  • Understanding GPU memory constraints, precision, batching, caching, and parallelism.

Responsibilities

  • Lead technical discovery to define use cases, workloads, and targets for model quality and latency.
  • Optimize inference using quantization, batching, caching, and parallelism.
  • Adapt models via prompt optimization, retrieval-augmented generation, and fine-tuning.
  • Troubleshoot performance across model execution, GPU, memory, and serving infra.
  • Lead technical customer engagements, run benchmarks, and guide deployment decisions.
  • Build reusable deployment configurations, evaluation tools, and runbooks.

Skills

Python
PyTorch
Hugging Face Transformers
LLM deployment
GPU inference
Model optimization
Customer engagement
Code writing
Benchmarks

Tools

vLLM
SGLang
TensorRT-LLM
CUDA
NVIDIA Nsight

Job description

CoreWeave is seeking a Senior Deployment Engineer to bring AI models into production, optimize performance, and integrate with enterprise systems. You will own technical delivery from discovery to adoption, working closely with customers and product/engineering teams.

Ideal candidates have 5+ years of hands-on experience in software/ML engineering, strong Python and ML framework skills, and expertise in deploying LLMs with model-serving tools. Excellent communication to customers is essential.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Forward-Deployed AI Inference Engineer
Senior Forward-Deployed AI Inference Engineer

Fdetimes • Toronto

Hybrid
CAD 150,000 - 210,000
Weekly lunch stipend
Health and dental benefits
RRSP matching / Pension
+3
Senior Forward Deployed AI Engineer (Python, Data & GenAI)
Senior Forward Deployed AI Engineer (Python, Data & GenAI)

Astra-North Infoteck Inc. • Toronto

On-site
CAD 120,000 - 180,000
Senior ML Engineer: Production AI Leader & Mentor
Senior ML Engineer: Production AI Leader & Mentor

Compunnel Inc. • Toronto

On-site
CAD 100,000 - 130,000
Senior Real-Time AI Engineer — LLM & ML Platforms
Senior Real-Time AI Engineer — LLM & ML Platforms

Plusgrade • Montreal

Hybrid
CAD 120,000 - 180,000
RRSP Matching
Comprehensive Health Plans
Flexible Paid Time Off
+2
AI Infrastructure Engineer
AI Infrastructure Engineer

Mission • Montreal

Hybrid
CAD 140,000 - 200,000
AI Developer
AI Developer

LuxeTech Inc. • Canada

On-site
CAD 80,000 - 100,000
Senior AI Systems Engineer — Production LLM Pipelines
Senior AI Systems Engineer — Production LLM Pipelines

Urban Ridge Supplies • Toronto

Hybrid
CAD 90,000 - 133,000
Enterprise AI Deployment Strategist
Enterprise AI Deployment Strategist

Wonderful • Baltics Corners

On-site
CAD 171,000 - 214,000
Lead AI and Data Engineer
Lead AI and Data Engineer

Dutch • Vancouver

On-site
CAD 120,000 - 180,000
Senior AI/ML Engineer & Technical Lead
Senior AI/ML Engineer & Technical Lead

BrainWave Professionals • Canada

On-site
CAD 120,000 - 160,000