Senior Inference ML Engineer: Transformers & Vision

We Love AI Jobs

Ottawa

Hybrid

CAD 180,000 - 240,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Cerebras Systems is seeking a Senior Research Engineer for the Inference ML team to adapt and optimize language and vision models for our Cerebras hardware. You will collaborate with researchers and engineers to design, prototype, validate, and optimize end-to-end inference pipelines.

Responsibilities include advancing speculative decoding, pruning, compression, and sparse attention, training models to convergence, and profiling performance to deliver low-latency inference at scale.

Qualifications

  • Bachelor’s, Master’s, or PhD in CS/Engineering with 4+ years of ML software development.
  • 4+ years in software development for ML; 3+ years in ML/vision or NLP.
  • Proficiency in Python and/or C++ and experience with ML frameworks.

Responsibilities

  • Design, implement, and optimize transformer architectures for NLP and computer vision on Cerebras hardware.
  • Research and prototype inference algorithms with speculative decoding, pruning/compression, and sparse attention.
  • Train models to convergence, perform hyperparameter sweeps, and analyze results for next steps.
  • Bring up new models on Cerebras system, validate functionality, and troubleshoot integration issues.
  • Profile and optimize model code to maximize throughput and minimize latency.
  • Develop tooling to surface bottlenecks and guide optimization strategies for inference workloads.
  • Collaborate across software, hardware, and product teams from inception to delivery.

Skills

Python
C++
PyTorch
Transformers
vLLM
SGLang
Triton
CUDA

Education

Bachelor’s degree in CS/Engineering
Master’s degree in CS/Engineering
PhD in CS/Engineering
Equivalent practical experience

Tools

PyTorch
Transformers
vLLM
SGLang
CUDA
Triton

Job description

Cerebras Systems is seeking a Senior Research Engineer for the Inference ML team to adapt and optimize language and vision models for our Cerebras hardware. You will collaborate with researchers and engineers to design, prototype, validate, and optimize end-to-end inference pipelines.

Responsibilities include advancing speculative decoding, pruning, compression, and sparse attention, training models to convergence, and profiling performance to deliver low-latency inference at scale.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Research Engineer - Inference ML
Senior Research Engineer - Inference ML

We Love AI Jobs • Ottawa

Hybrid
CAD 180,000 - 240,000
Staff Software Engineer, AI Inference Systems
Staff Software Engineer, AI Inference Systems

Cerebras • Toronto

On-site
CAD 140,000 - 190,000
Senior Software Engineer, ML API – AI Inference
Senior Software Engineer, ML API – AI Inference

FDE Times • Toronto

On-site
CAD 209,000 - 293,000
Senior Software Engineer, ML API - AI Inference
Senior Software Engineer, ML API - AI Inference

Cerebras • Toronto

On-site
CAD 130,000 - 190,000
Remote-friendly? (not stated)
Full Stack LLM Engineer
Full Stack LLM Engineer

FDE Times • Toronto

On-site
CAD 120,000 - 190,000
Competitive salary
Career growth
Dynamic work environment
+1
Applied Machine Learning Research Scientist
Applied Machine Learning Research Scientist

FDE Times • Ottawa

On-site
CAD 130,000 - 200,000
Full Stack LLM Engineer
Full Stack LLM Engineer

Cerebras • Toronto

On-site
CAD 80,000 - 120,000
Competitive salary and benefits package
Opportunities for professional growth
Dynamic and innovative work environment
Engineering Manager, Inference Router: Global Low-Latency
Engineering Manager, Inference Router: Global Low-Latency

Cerebras • Toronto

On-site
CAD 180,000 - 260,000
Staff Software Engineer, Inference API
Staff Software Engineer, Inference API

Cerebras • Toronto

On-site
CAD 140,000 - 190,000
Co-Design & Next-Gen AI Performance Engineer
Co-Design & Next-Gen AI Performance Engineer

Cerebras • Toronto

On-site
CAD 110,000 - 170,000