Senior Principal Researcher – AI Agent & Multimodal Interaction System

Aimlroles

Markham

On-site

CAD 150,000 - 190,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Huawei Canada, through its Human-Machine Interaction Lab, seeks a visionary Senior Principal Researcher to steer end-to-end multimodal AI interactions across devices. The role emphasizes agent autonomy, cross-functional leadership, and translating cutting-edge multimodal models into real-world user experiences.

You will guide design across platforms like mobile, automotive, wearables, and smart environments, combining perception, reasoning, and action into seamless user flows and high-value IP.

Qualifications

  • PhD or Master’s degree in Computer Science (HCI/AI) or Electrical Engineering.
  • Strong understanding of multimodal AI systems and how perception and MM language models interact in real-world apps.
  • Experience designing or shipping AI-driven user experiences at scale (e.g., agents, copilots, multimodal interfaces).
  • Ability to think beyond GUI/VUI and define new interaction models enabled by AI.
  • Hands-on experience with Multimodal LLMs or Vision-Language Models in real-world apps.
  • Familiarity with end-to-end stack of intelligent systems (perception–reasoning–action).
  • Strong product intuition and cross-functional communication skills.
  • Proven impact via innovative interaction experiences or influential research/publications.

Responsibilities

  • Define and drive the end-to-end vision for next-generation AI agent–native multimodal interaction systems.
  • Design interaction models centered on agent autonomy and collaboration beyond traditional GUI/VUI.
  • Lead integration of multimodal foundation models into real-world interaction systems across platforms.
  • Lead the design of seamless multimodal experiences across Mobile, AI PC, automotive, wearables, and smart environments.
  • Iterate quickly from concept to production-ready solutions with usability and latency considerations.
  • Identify opportunities to unify interaction frameworks across modalities to reduce fragmentation.
  • Drive end-to-end experience thinking from perception to user feedback, not just component optimization.
  • Stay at the forefront of AI agents and multimodal models and translate trends into product innovations.

Skills

Multimodal AI systems
AI-driven user experiences
Cross-functional collaboration
End-to-end intelligent systems
Hands-on Multimodal LLMs
Product intuition

Education

PhD or Master’s in CS/EE

Job description

Huawei Canada has an immediate permanent opening for a Senior Principal Researcher.

About the team:

The Huawei Human-Machine Interaction Lab unites global researchers, engineers, and designers to redefine human technology relationships through user centered, hands on research. We focus on agentic AI and multimodal interaction (voice, touch, vision, gesture) across smartphones, wearables, and emerging devices—advancing agentic workflows, multi-agent orchestration, and intuitive human-AI interfaces. By tightly integrating sensing, algorithms, and systems, our prototype driven work ships directly to products, enabling seamless task delegation and human AI collaboration at scale.

About the job:

  • Define and drive the end-to-end vision for next-generation AI agent–native multimodal interaction systems. Define how agents perceive, reason, and act through multimodal signals (voice, vision, touch, context).

  • Design interaction models centered on agent autonomy and collaboration, moving beyond traditional GUI/VUI toward intent-driven and context-aware experiences.

  • Lead the design of seamless multimodal experiences across platforms (e.g., mobile, automotive, wearables, smart environments), ensuring consistency and adaptability.

  • Lead the integration of multimodal foundation models (VLM, multimodal LLMs) into real-world interaction systems.

  • Lead the design of seamless multimodal experiences across: Mobile, AI PC, automotive, AI glasses, wearable devices, and smart environments.

  • Iterate quickly from concept to production-ready solutions, evaluating usability, latency, feedback loops, and real-world behavior prior to production.

  • Identify opportunities to unify interaction frameworks across modalities, reducing fragmentation between voice, visual, and physical interfaces.

  • Drive end-to-end experience thinking, from perception and reasoning to response and user feedback, rather than isolated component optimization.

  • Stay at the forefront of industry trends (e.g., AI agents, multimodal foundation models, embodied AI) and translate them into product innovations and high-value IP / patents.

About the ideal candidate:

  • PhD or Master degree in Computer Science (HCI, AI, Computing System), Electrical Engineering, or a related field.

  • Strong understanding of multimodal AI systems, including how perception (audio, vision, other sensing modalities) and MM language models interact in real-world applications.

  • Experience designing or shipping AI-driven user experiences (e.g., voice assistants, copilots, agents, or multimodal interfaces) at scale.

  • Ability to think beyond existing paradigms (e.g., GUI, VUI) and define new interaction models enabled by AI.

  • Hands-on experience with Multimodal LLMs or Vision-Language Models and Real-world applications of foundation models in interaction systems.

  • Familiarity with the end-to-end stack of intelligent systems (perception reasoning action), even if not specializing in a single component.

  • Strong product intuition and user-centric thinking, with the ability to balance technical feasibility and experience quality.

  • Proven track record of delivering innovative interaction experiences to large-scale consumer products, or equivalent impact through influential research (publications at CHI, UIST, NeurIPS, InterSpeech, ICASSP, ICLR, or similar venues).

  • Excellent cross-functional communication skills, able to align engineering, design, and research stakeholders.

Additional Information:

Huawei Canada is committed to a fair, inclusive, and accessible recruitment process. If you require accommodation during any stage of the hiring process, please let us know and we will work with you to meet your needs.

All applications for this position are reviewed directly by our hiring team, we do not use artificial intelligence tools to screen or select candidates.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Principal Researcher – AI Agent & Multimodal Interaction System
Senior Principal Researcher – AI Agent & Multimodal Interaction System

Huawei Canada • Markham

On-site
CAD 100,000 - 130,000
Applied AI Researcher – Multimodal Intelligence
Applied AI Researcher – Multimodal Intelligence

Huawei Canada • Markham

On-site
CAD 106,000 - 156,000
Senior Researcher - Agent Human-Computer Interaction (Agent HCI)
Senior Researcher - Agent Human-Computer Interaction (Agent HCI)

Huawei Canada • Markham

On-site
CAD 127,000 - 225,000
Intern Researcher – Multimodal AI & Interaction
Intern Researcher – Multimodal AI & Interaction

Huawei Canada • Markham

On-site
CAD 58,000 - 104,000
Research Engineer – Multimodal AI & Interaction
Research Engineer – Multimodal AI & Interaction

Huawei Canada • Markham

On-site
CAD 106,000 - 156,000
Senior Researcher - Agent Human-Computer Interaction (Agent HCI)
Senior Researcher - Agent Human-Computer Interaction (Agent HCI)

Huawei Canada • Markham

On-site
CAD 127,000 - 225,000
Researcher – Human-Computer Interaction
Researcher – Human-Computer Interaction

Huawei Canada • Markham

On-site
CAD 106,000 - 156,000
Intern Researcher - AI Agents
Intern Researcher - AI Agents

Huawei • Montreal

On-site
CAD 58,000 - 104,000
Senior Principal AI Agent & Multimodal Researcher
Senior Principal AI Agent & Multimodal Researcher

Aimlroles • Markham

On-site
CAD 150,000 - 190,000
Researcher – Computer Vision & Human-Centered AI
Researcher – Computer Vision & Human-Centered AI

Huawei Canada • Markham

On-site
CAD 147,000 - 216,000