LLM Serving Engineer, Cloud AI Platform Architect

Qualcomm; Markham; On-site; CAD 215,392 - 323,088; Full time

Benefits offered by this job

Competitive salary

Annual discretionary bonus

Stock options

Comprehensive benefits package

Job summary

A leading technology firm is hiring LLM Serving Engineers in Markham to develop scalable AI inference platforms. Candidates will work on machine learning packages and directly collaborate with various teams to drive advanced solutions. Ideal applicants should possess a Master's degree or equivalent experience, with strong skills in Python and deep learning, particularly using PyTorch. The role offers a competitive salary in the range of $158,400.00 - $237,600.00, alongside excellent benefits and a collaborative work environment.

Qualifications

• Hands-on experience in LLM serving/orchestration packages.
• Deep understanding of transformer-based architectures.
• Experience with parallel and distributed programming.

Responsibilities

• Build a scalable LLM inference platform.
• Develop LLM Serving packages like Triton.
• Collaborate with customers and internal teams.

Skills

Hands-on experience with LLM serving packages

Deep understanding of foundational LLMs

Strong experience in developing language models using PyTorch

Strong computer science fundamentals

Understanding of computer architecture

Strong Python development skills

Experience in analyzing deep learning workloads

Proactive learning about inference optimization techniques

Excellent communication skills

Education

MS in Computer Science, Machine Learning, Computer Engineering or Electrical Engineering

Bachelor's degree in Computer Science or related field

PhD in Computer Science or related field

Job description

A leading technology firm is hiring LLM Serving Engineers in Markham to develop scalable AI inference platforms. Candidates will work on machine learning packages and directly collaborate with various teams to drive advanced solutions. Ideal applicants should possess a Master's degree or equivalent experience, with strong skills in Python and deep learning, particularly using PyTorch. The role offers a competitive salary in the range of $158,400.00 - $237,600.00, alongside excellent benefits and a collaborative work environment.