Principal Architect - Large Model and Training System Performance Optimization

Huawei Technologies Canada Co., Ltd.; Vancouver; On-site; USD 121,000 - 230,000; Full time

Job summary

An established industry player is seeking a Principal Architect to lead the design of advanced AI training systems. This role involves analyzing industry trends, collaborating with global research teams, and defining technology roadmaps for innovation. The ideal candidate will possess a Master's or PhD in relevant fields, alongside extensive experience in architecting complex software-hardware solutions. Join a forward-thinking company that is at the forefront of AI and deep learning, where your expertise will drive the future of technology and enhance performance across various applications. This is an exciting opportunity to shape the next generation of AI training systems in a dynamic environment.

Qualifications

• 5+ years in architecting AI training systems with a focus on performance.
• Master's or PhD in Computer Science or related field required.

Responsibilities

• Lead architecture design for Ascend training products and innovate continuously.
• Collaborate with global teams to align on strategic goals and project planning.

Skills

Architecting large-scale AI training systems

Deep Learning

C/C++ programming

Python programming

Documentation skills

Performance optimization

Effective communication

AI accelerators knowledge

Education

Master's in Computer Science

PhD in Computer Science

Bachelor's in Math/Statistics

Tools

veRL

Ray

Nsight Systems

Nsight Compute

DLProf

PyTorch

Megatron

DeepSpeed

Job description

Huawei Canada has an immediate permanent opening for a Principal Architect

About the team:

The Computing Data Application Acceleration Lab aims to create a leading global data analytics platform organized into three specialized teams using innovative programming technologies. This team focuses on full-stack innovations, including software-hardware co-design and optimizing data efficiency at both the storage and runtime layers. This team also develops next-generation GPU architecture for gaming, cloud rendering, VR/AR, and Metaverse applications.

One of the goals of this lab is to enhance algorithm performance and training efficiency across industries, fostering long-term competitiveness.

About the job:

1. Lead the architecture design of Ascend training products, driving the continuous evolution of architectural competitiveness.
2. Analyze mainstream scenario requirements and industry technology trends for Ascend, introducing innovative technologies to ensure sustained leadership in architectural competitiveness.
3. Identify requirements for MindX, AI frameworks, acceleration libraries, and chip hardware, building a robust software-hardware architecture for Ascend training to achieve ongoing commercial success.
4. Collaborate with other departments/teams from Huawei’s global research centers to align on strategic goals.
5. Spearhead project planning and define the technology/product development roadmap to guide long-term innovation.

The base salary for this position ranges from $121,000 to $230,000 depending on education, experience, and demonstrated expertise.

About the ideal candidate:

1. Master’s or PhD in Computer Science, Math/Statistics, with a focus on AI & Deep Learning.
2. 5+ years of experience in architecting large-scale AI training systems or similar complex software-hardware integrated solutions.
3. Excellent documentation skills for writing internal reports and/or publishing research papers. Effective communication skills for presentations to internal and external audiences. A proactive attitude with a strong ability to tackle challenges and adapt to evolving requirements and dynamic work environment.
4. Working knowledge of AI accelerators or full-stack AI acceleration systems and Deep Reinforcement Learning.
5. Hands-on experience with veRL or Ray for large-scale model training.
6. Familiarity with processor architectures and relevant work experience, with hands-on expertise in designing and developing complex system software architectures, and experience in performance optimization on GPU/NPU or similar hardware platforms.
7. Solid understanding of deep learning fundamentals, proficiency with the PyTorch framework, and practical experience in performance optimization using upper-layer distributed frameworks such as Megatron or DeepSpeed.
8. Strong programming skills with proficiency in C/C++ and Python.
9. Experience using performance analysis tools such as Nsight Systems, Nsight Compute, and DLProf.