LLM Serving Engineer, Cloud AI Platform Architect

QUALCOMM, Inc.

Markham

On-site

CAD 215,392 - 323,088

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Competitive salary
Annual discretionary bonus
Stock options
Comprehensive benefits package

Job summary

A leading technology firm is hiring LLM Serving Engineers in Markham to develop scalable AI inference platforms. Candidates will work on machine learning packages and directly collaborate with various teams to drive advanced solutions. Ideal applicants should possess a Master's degree or equivalent experience, with strong skills in Python and deep learning, particularly using PyTorch. The role offers a competitive salary in the range of $158,400.00 - $237,600.00, alongside excellent benefits and a collaborative work environment.

Qualifications

  • Hands-on experience in LLM serving/orchestration packages.
  • Deep understanding of transformer-based architectures.
  • Experience with parallel and distributed programming.

Responsibilities

  • Build a scalable LLM inference platform.
  • Develop LLM Serving packages like Triton.
  • Collaborate with customers and internal teams.

Skills

Hands-on experience with LLM serving packages
Deep understanding of foundational LLMs
Strong experience in developing language models using PyTorch
Strong computer science fundamentals
Understanding of computer architecture
Strong Python development skills
Experience in analyzing deep learning workloads
Proactive learning about inference optimization techniques
Excellent communication skills

Education

MS in Computer Science, Machine Learning, Computer Engineering or Electrical Engineering
Bachelor's degree in Computer Science or related field
PhD in Computer Science or related field

Job description

A leading technology firm is hiring LLM Serving Engineers in Markham to develop scalable AI inference platforms. Candidates will work on machine learning packages and directly collaborate with various teams to drive advanced solutions. Ideal applicants should possess a Master's degree or equivalent experience, with strong skills in Python and deep learning, particularly using PyTorch. The role offers a competitive salary in the range of $158,400.00 - $237,600.00, alongside excellent benefits and a collaborative work environment.
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior LLMOps Engineer — Cloud AI Inference + Equity
Senior LLMOps Engineer — Cloud AI Inference + Equity

TEEMA Solutions Group • Toronto

Hybrid
CAD 120,000 - 160,000
Competitive salary
Meaningful equity
Innovative work culture
LLM Engineer — Hybrid Toronto, Agentic AI & Pipelines
LLM Engineer — Hybrid Toronto, Agentic AI & Pipelines

Mindlance, Inc. • Toronto

Hybrid
CAD 55,104 - 68,880
Staff GenAI Engineer: Scale LLMs & AI Platforms
Staff GenAI Engineer: Scale LLMs & AI Platforms

Okta Inc. • Toronto

On-site
CAD 154,000 - 230,000
Health insurance
Equity options
Paid leave
LLM Engineer
LLM Engineer

Mindlance, Inc. • Toronto

Hybrid
CAD 55,104 - 68,880
AI Developer: Generative AI & LLMs Specialist
AI Developer: Generative AI & LLMs Specialist

LuxeTech Inc. • Canada

On-site
CAD 80,000 - 100,000
AI Engineer: LLM Agents & Product Insights
AI Engineer: LLM Agents & Product Insights

OpenReplay • Quebec

On-site
CAD 90,000 - 150,000
AI & LLM Engineer
AI & LLM Engineer

Peltrex • Toronto

Hybrid
CAD 85,000 - 130,000
ML Engineer – Generative AI & LLMs (Remote)
ML Engineer – Generative AI & LLMs (Remote)

Ample Insight Inc • Toronto

Hybrid
CAD 110,000 - 170,000
Senior ML Engineer: LLM Retrieval & Agentic Workflows
Senior ML Engineer: LLM Retrieval & Agentic Workflows

Klue • Toronto

Hybrid
CAD 120,000 - 150,000
Competitive base salary
Extended health & dental benefits
Opportunity for employee stock options
+1
AI Engineer: Production LLM for Field Ops
AI Engineer: Production LLM for Field Ops

Remarcable, Inc. • Vancouver

Hybrid
CAD 110,000 - 180,000
Competitive salary
Performance-based bonus
Health & wellness benefits