Intern Researcher - Efficient Architecture for LLMs

Huawei Technologies Co.; Montreal (administrative region); Hybrid; CAD 20,000 - 27,000; Part time

Job summary

Huawei Canada is offering an internship for a Researcher in Montreal under the Noah’s Ark Lab. You will assist in proposing novel research ideas to improve the efficiency and scalability of large language models and collaborate on end-to-end projects.

The role requires pursuing a Ph.D. or Masters in CS or related field, deep NLP/LLM knowledge, Python and PyTorch skills, and the ability to communicate findings. The lab emphasizes cutting-edge AI research and contribution to products.

Qualifications

• Currently pursuing a Ph.D. or Masters in Computer Science, Software Engineering, or a related field.
• A deep understanding of NLP and large language model (LLM) fundamentals and state-of-the-art methods, coupled with a strong theoretical grounding in machine learning.
• Expertise in modern LLM architectures, including transformer models (e.g., Llama, Qwen) and good knowledge in linear-attention models (e.g., GDN, Mamba, GLA).
• Strong programming skills in Python with expertise in PyTorch. Experience in training and evaluating LLMs.
• Familiarity with diffusion models is an asset.
• Excellent oral and written communication skills. Ability to work in a collaborative, research-oriented environment

Responsibilities

• Assist in proposing and exploring novel research ideas to improve the efficiency and scalability of large language models.
• Participate in applied research projects focused on enabling long-context LLMs, including work on efficient architectures, data curation, and post-training methods.
• Collaborate on end-to-end projects by designing and executing experiments, analyzing results, and presenting findings.
• Publish research in top-tier machine learning and natural language processing (NLP) conferences.
• Track advances across the LLM and AI ecosystem, translating new developments into actionable insights for the team.

Skills

NLP

LLM

Transformer architectures

Python

PyTorch

English proficiency

Education

Master's or PhD in Computer Science / Software Engineering or related

Tools

PyTorch

Job description

Huawei Canada has an immediate internship opening for a Researcher.

About the team:

Founded in 2012, the Noah’s Ark lab has evolved into a prominent research organization with notable achievements in academia and industry. The lab’s mission focuses on advancing artificial intelligence and related fields to benefit the company and society. Driven by impactful, long-term projects, the aim is to enhance state-of-the-art research while integrating innovations into the company's products and services, including LLMs, RL, NLP, computer vision, AI theory, and Autonomous driving.

About the job:

• Assist in proposing and exploring novel research ideas to improve the efficiency and scalability of large language models.

• Participate in applied research projects focused on enabling long-context LLMs, including work on efficient architectures, data curation, and post-training methods.

• Collaborate on end-to-end projects by designing and executing experiments, analyzing results, and presenting findings.

• Publish research in top-tier machine learning and natural language processing (NLP) conferences.

• Track advances across the LLM and AI ecosystem, translating new developments into actionable insights for the team.

About the ideal candidate:

• Currently pursuing a Ph.D. or Masters in Computer Science, Software Engineering, or a related field.

• A deep understanding of NLP and large language model (LLM) fundamentals and state-of-the-art methods, coupled with a strong theoretical grounding in machine learning.

• Expertise in modern LLM architectures, including transformer models (e.g., Llama, Qwen) and good knowledge in linear-attention models (e.g., GDN, Mamba, GLA).

• Strong programming skills in Python with expertise in PyTorch. Experience in training and evaluating LLMs.

• Familiarity with diffusion models is an asset.

• Excellent oral and written communication skills. Ability to work in a collaborative, research-oriented environment

Huawei aims to support a French-speaking work environment for its employees in Quebec. We have taken steps to avoid requiring a language other than French for this position. However, proficiency in English is essential for this role for the following reasons:

The person will be required to communicate regularly with colleagues located outside Quebec, where English is the primary language used for communication between offices. In addition, the nature of the tasks related to this position, which falls within a highly specialized field of artificial intelligence, also requires knowledge of English.