SGLang & Inference Stack Engineer — GPU ML Developer

CareerArc; Vancouver; On-site; CAD 85,000 - 110,000; Full time

Job summary

A leading technology company in Vancouver seeks a GPU Software Engineer to optimize deep learning frameworks and enhance GPU performance. The role involves collaborating on GPU kernel development and contributing to SGLang. Ideal candidates will have strong programming skills in C++ and/or Python, along with a Bachelor's or Master's degree in a related field. This position offers an opportunity to work in a dynamic and innovative environment, pushing the boundaries of AI and machine learning.

Benefits

Comprehensive health benefits

Career advancement opportunities

Innovative work environment

Qualifications

• Skilled engineer with strong technical and analytical expertise in GPGPU C++.
• Ability to manage development efforts and deliver high-quality solutions.
• Strong programming skills in C++ and/or Python.

Responsibilities

• Optimize deep learning frameworks for optimal performance on AMD GPUs.
• Collaborate with GPU library and compiler teams to align optimizations.
• Contribute to SGLang development across AMD GPU platforms.

Skills

GPGPU C++

Triton

Data science analysis

Problem-solving

Collaborative work

Education

Bachelor’s or Master’s in Computer Science or related field

Tools

HIP

CUDA

PyTorch

Job description

A leading technology company in Vancouver seeks a GPU Software Engineer to optimize deep learning frameworks and enhance GPU performance. The role involves collaborating on GPU kernel development and contributing to SGLang. Ideal candidates will have strong programming skills in C++ and/or Python, along with a Bachelor's or Master's degree in a related field. This position offers an opportunity to work in a dynamic and innovative environment, pushing the boundaries of AI and machine learning.