Senior Engineer - Large Model and Training System Performance Optimization

Huawei Canada; Vancouver; On-site; CAD 121,000 - 230,000; Full time

Job summary

An innovative firm is seeking a Senior Engineer to enhance AI model training efficiency and performance. This role involves collaborating with global research teams to develop cutting-edge algorithms and optimize deep learning models across various applications. Ideal candidates will possess a Master's or PhD in Computer Science with a focus on AI and have a strong background in programming, particularly in Python and C/C++. Join a dynamic team that is pushing the boundaries of technology and shaping the future of AI in an exciting and fast-paced environment.

Qualifications

• 2+ years of experience in optimizing training of deep learning models.
• Excellent documentation and communication skills for internal and external presentations.

Responsibilities

• Lead research on algorithms to accelerate AI model training.
• Publish high-quality AI research papers and attend conferences.

Skills

Optimizing performance of deep learning models

Documentation skills

Communication skills

Programming in C/C++

Programming in Python

Understanding of deep learning fundamentals

Experience with performance analysis tools

Education

Master's or PhD in Computer Science

Focus on AI & Deep Learning

Tools

PyTorch

Nsight Systems

Nsight Compute

DLProf

veRL

Ray

Megatron

DeepSpeed

Job description

Senior Engineer - Large Model and Training System Performance Optimization

Join to apply for the Senior Engineer - Large Model and Training System Performance Optimization role at Huawei Canada

Senior Engineer - Large Model and Training System Performance Optimization

4 weeks ago Be among the first 25 applicants

Join to apply for the Senior Engineer - Large Model and Training System Performance Optimization role at Huawei Canada

Huawei Canada has an immediate permanent opening for a Senior Engineer.

About the team:

The Computing Data Application Acceleration Lab aims to create a leading global data analytics platform organized into three specialized teams using innovative programming technologies. This team focuses on full-stack innovations, including software-hardware co-design and optimizing data efficiency at both the storage and runtime layers. This team also develops next-generation GPU architecture for gaming, cloud rendering, VR/AR, and Metaverse applications.

One of the goals of this lab are to enhance algorithm performance and training efficiency across industries, fostering long-term competitiveness.

About the job:

• Track the trend of AI theory and technology development in the world and generate research report and proposals for promoting Ascend system accordingly.
• Lead or participate in research of algorithms in accelerating the training of the market-driven AI models (CV/NLP/GNN/…), reaching/exceeding the state of the art accuracy, and develop a proof of concept of the algorithms. Those algorithms include but are not limited to the following: optimizers, loss functions, new model architecture, mix precision, model compression, learning technologies (e.g., meta-learning), etc.
• Publish relevant high-quality AI research papers when necessary and approved, and attend conferences for increasing public awareness of Huawei’s Ascend products; file high-value patents on critical algorithms/processes that are of potential business gain.
• Team up with other departments/teams from Huawei’s global research centers for collaboration.
• Assist the team lead on the planning of projects and definition of technology/products development road map.
  
  

The base salary for this position ranges from $121,000 to $230,000 depending on education, experience and demonstrated expertise.

Job requirements

About The Ideal Candidate：

• Master’s or PhD in Computer Science, Math/Statistics, with a focus on AI & Deep Learning.
• 2+ years of working experience in optimizing the performance of training deep learning models and/or their applications in domains such as CV, NLP, or GNN. A proactive attitude with a strong ability to tackle challenges and adapt to evolving requirements and dynamic work environment
• Excellent documentation skills for writing internal reports and/or publishing research papers. Effective communication skills for presentations to internal and external audiences.
• Working knowledge of AI accelerators or full-stack AI acceleration systems and Deep Reinforcement Learning.
• Hands-on experience with veRL or Ray for large-scale model training.
• Familiarity with processor architectures and relevant work experience, with hands-on expertise in designing and developing complex system software architectures, and experience in performance optimization on GPU/NPU or similar hardware platforms.
• Solid understanding of deep learning fundamentals, proficiency with the PyTorch framework, and practical experience in performance optimization using upper-layer distributed frameworks such as Megatron or DeepSpeed.
• Strong programming skills with proficiency in C/C++ and Python.
• Experience using performance analysis tools such as Nsight Systems, Nsight Compute, and DLProf.

Seniority level

• Seniority level

  Mid-Senior level

Employment type

• Employment type

  Full-time

Job function

• Job function

  Engineering and Information Technology

• Industries

  Telecommunications

Referrals increase your chances of interviewing at Huawei Canada by 2x

Get notified about new Senior Electrical Engineer jobs in Vancouver, British Columbia, Canada.

Electrical Engineering Manager (Relocation to Interior BC)

Senior Electrical Engineer/Project Manager - Buildings

Burnaby, British Columbia, Canada 21 hours ago

Principal Electrical Engineer for Energy, Mining, and Industrial

Burnaby, British Columbia, Canada $95,967.00-$141,390.00 20 hours ago

Principal Electrical Engineer for Energy, Mining, and Industrial

Burnaby, British Columbia, Canada 2 days ago

Burnaby, British Columbia, Canada 1 hour ago

Burnaby, British Columbia, Canada 1 month ago

engineer, electrical energy transmission

Burnaby, British Columbia, Canada 3 days ago

Richmond, British Columbia, Canada 3 months ago

Richmond, British Columbia, Canada 2 months ago

engineer, electrical energy transmission planning

Burnaby, British Columbia, Canada 1 week ago

Richmond, British Columbia, Canada 5 days ago

Burnaby, British Columbia, Canada 3 weeks ago

Burnaby, British Columbia, Canada 7 hours ago

Burnaby, British Columbia, Canada 3 days ago

Delta, British Columbia, Canada 3 days ago

Inter/Senior Electrical Engineer (P.Eng. with EGBC)

Burnaby, British Columbia, Canada 1 month ago

Senior Electrical Engineer (P.Eng. with EGBC)

Burnaby, British Columbia, Canada 1 month ago

Surrey, British Columbia, Canada 2 days ago

Surrey, British Columbia, Canada 3 months ago

Burnaby, British Columbia, Canada CA$127,000.00-CA$160,000.00 3 weeks ago

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.