Senior Research Scientist – Efficient Multimodal Video Generation

Huawei

Zürich

On-site

CHF 180,000 - 240,000

Full time

2 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Huawei’s European Research Institute seeks a Senior Research Scientist to lead research on faster, more efficient large multimodal and video generation models. You will shape directions, lead projects end to end, and stay hands-on implementing and running experiments.

You will mentor researchers, publish at top venues, and collaborate with universities and industry to advance efficient AI on NPUs/GPUs across Europe.

Qualifications

  • PhD in a relevant field with at least 5 years of research experience after the PhD.
  • Strong publication record at top venues in generative AI or computer vision.
  • Hands-on experience with diffusion, flow‑matching, or other large generative models.
  • Proven ability to lead research projects and mentor researchers or students.
  • Strong programming skills in Python and PyTorch; C++ is an advantage.
  • Excellent written and oral communication.

Responsibilities

  • Define and lead research directions in the Multimodal Efficiency stream.
  • Lead end‑to‑end projects from problem formulation to scalable results and demos.
  • Hands‑on research: implement, train, and optimize models.
  • Mentor junior researchers and co‑supervise interns.
  • Collaborate with systems and engineering teams to accelerate models on NPUs/GPUs.
  • Publish at top venues and contribute to open‑source projects.
  • Define benchmarks for quality, latency, and cost at scale.
  • Represent the team in technical reviews and conferences.

Skills

Multimodal AI
Video Generation
Research leadership
Publications
Python
PyTorch
C++
Communication

Education

PhD in Computer Science, Electrical Engineering, AI or related field

Tools

Python
PyTorch
C++

Job description

About Us

Huawei is a global leader in information and communications technology (ICT), driving innovation and shaping the future of an intelligent world. With a presence in over 170 countries and a strong commitment to research and development, Huawei continues to push the boundaries of technology.

Huawei's European Research Institute (ERI) brings together more than 1,500 researchers across over 20 sites in Europe, including our Research Center in Switzerland. Our Swiss research laboratory focuses on pioneering next-generation computing architectures and systems for the AI era, spanning innovative hardware, software, and algorithms. Working closely with leading universities and academic partners worldwide, we foster an open, collaborative research environment dedicated to fundamental scientific breakthroughs and long-term innovation.

Our vision is to become a world-leading research center for computing architectures and systems in the AI era, shaping the future of intelligent computing.

About The Team

We are a research team based in Europe, working at the intersection of Generative AI, Video and Efficient AI. We collaborate closely with leading universities and research institutions, and with engineering teams, to explore and build the next generation of efficient multimodal AI systems.

Our work centres on efficient real-time video generation. We are moving toward mixture-of-experts (MoE) video models, streaming world models, and models that keep learning while they generate.

The team has two streams: Architecture and Systems, and Multimodal Efficiency. This position is in the Multimodal Efficiency stream, which makes video and multimodal models faster and cheaper at the model and algorithm level, and works closely with the systems stream to run them in real time on NPU/GPU clusters.

The Role

We are looking for a Senior Research Scientist to lead research on making large multimodal and video generation models faster and more efficient. You will shape the research directions of the Multimodal Efficiency stream, lead projects from problem formulation to results at scale, and mentor researchers and interns. You will stay hands‑on: implementing, running experiments and building working systems.

What You Will Work On
  • Token efficiency for video: adaptive, content‑aware token compression and merging, and positional encodings (e.g. RoPE) designed to work with compressed or multi‑resolution tokens
  • Long‑horizon and streaming generation: memory‑ and KV‑cache‑efficient autoregressive video, history compression, and few‑step and streaming distillation
  • Sparse and structured attention for long video sequences
  • Step distillation, caching across denoising steps, and pruning
  • Quantization and low‑precision inference (FP8/FP4, MX formats) for diffusion and flow‑matching models
  • MoE video models: expert routing and MoE‑specific acceleration
  • Efficient end‑to‑end execution of large multimodal models, including VAE encoding and decoding, and joint audio‑video generation
  • Efficient agentic multimodal pipelines: agents that call LLMs, VLMs and video/speech generators, with KV cache reuse across steps and latency‑aware planning
  • Workload analysis and hardware‑aware model design: compute, memory and latency models that guide algorithm choices on NPUs and GPUs, together with the systems stream
Your Responsibilities
  • Define and lead research directions in the Multimodal Efficiency stream, aligned with the team roadmap
  • Lead projects end to end: from problem formulation to prototype to results at scale, and turn them into real‑time demos and deployable systems
  • Hands‑on research: implement, train and optimize models
  • Mentor junior researchers, co‑supervise interns
  • Work with the systems stream and engineering teams to profile and accelerate models on large NPU/GPU clusters
  • Publish at top venues (CVPR, ICCV/ECCV, NeurIPS, ICLR, ICML, SIGGRAPH, MLSys) and contribute to open‑source projects
  • Define benchmarks and metrics for quality, latency (real‑time factor) and cost at scale
  • Represent the team in technical reviews, at conferences and in workshops
What We Are Looking For
  • PhD in Computer Science, Electrical Engineering, Artificial Intelligence, Machine Learning or a related field, with at least 5 years of research experience after the PhD in academia or industry
  • Strong publication record at top venues in generative AI, computer vision, multimodal AI or efficient ML, including first‑author papers
  • Hands‑on experience with diffusion, flow‑matching or other large generative models (multi‑billion parameters)
  • Demonstrated, measurable gains in model efficiency (latency, memory or cost), for example through distillation, sparse attention, token reduction or quantization
  • Experience leading research projects and mentoring researchers or studentsExperience with large‑scale distributed training or inference
  • Strong programming skills in Python and PyTorch; C++ is an advantage
  • Clear communication, in writing and in talks
Experience in one or more of the following areas is an advantage:
  • Video generation, streaming or autoregressive video, or world models
  • Token merging or pruning, adaptive tokenization, or positional encodings for multi‑resolution inputs
  • Step distillation, sparse or efficient attention, quantization
  • MoE models
  • KV cache optimization and long‑context modeling
  • Profiling and optimizing models on NPUs or GPUs
  • RL or preference optimization for generative models
  • Open‑source AI projects
  • Supervising PhD students or building academic collaborations
What We Offer
  • The opportunity to shape the research directions of a growing research stream
  • Hands‑on research on Multimodal AI, Video Generation, World Models and Efficient AI
  • Close collaboration with researchers and engineers from leading universities, research institutions and industry teams
  • Access to large‑scale AI models and advanced AI computing platforms
  • Support for publishing, open‑source contributions and conference attendance
  • The opportunity to mentor researchers and supervise interns and PhD students
  • A highly international research environment in Europe
Who We Are Looking For

We are particularly interested in researchers who are not only excited about making AI models smarter, but who want to answer:

  • How can we make large multimodal models faster, more scalable and more efficient, and run them in real time on real hardware?

If you want to lead hands‑on research on efficient Multimodal AI and Video Generation, we would love to hear from you.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Research Scientist – Efficient Multimodal Video Generation
Research Scientist – Efficient Multimodal Video Generation

Huawei Switzerland • Zürich

On-site
CHF 120,000 - 180,000
Hands-on research
Mentoring by senior researchers
International collaboration
+4
Senior Research Scientist – Efficient Multimodal Video Generation
Senior Research Scientist – Efficient Multimodal Video Generation

Huawei Switzerland • Zürich

On-site
CHF 140,000 - 240,000
International research environment in 
European research collaboration
Research Scientist – AI Performance Optimization and Systems
Research Scientist – AI Performance Optimization and Systems

Huawei • Zürich

On-site
CHF 120,000 - 190,000
Hands-on AI research environment
Publish and open-source support
Mentor interns and collaborate with EU
Lead Scientist, Efficient Multimodal Video Generation
Lead Scientist, Efficient Multimodal Video Generation

Huawei • Zürich

On-site
CHF 180,000 - 240,000
Research Scientist – AI Performance Optimization and Systems
Research Scientist – AI Performance Optimization and Systems

Huawei Switzerland • Zürich

On-site
CHF 120,000 - 190,000
Research Scientist – Efficient and Controllable Generative Models
Research Scientist – Efficient and Controllable Generative Models

Huawei • Zürich

On-site
CHF 130,000 - 180,000
Competitive compensation
International research environment
Close ties to ETH Zurich & EPFL
Member of Technical Staff - AI Research Engineer
Member of Technical Staff - AI Research Engineer

Sarah Smith • Zürich

Hybrid
CHF 90,000 - 120,000
Visa sponsorship
Flexible PTO
Regular offsites and in-person events
Member of Technical Staff - AI Research Engineer
Member of Technical Staff - AI Research Engineer

GenPeach AI • Zürich

Hybrid
CHF 120,000 - 190,000
Visa sponsorship
Remote-friendly
Offsites
+1
Research Scientist: Real-Time Efficient Multimodal Video AI
Research Scientist: Real-Time Efficient Multimodal Video AI

Huawei Switzerland • Zürich

On-site
CHF 120,000 - 180,000
Hands-on research
Mentoring by senior researchers
International collaboration
+4
Lead Research Scientist: Real-time Multimodal Video AI
Lead Research Scientist: Real-time Multimodal Video AI

Huawei Switzerland • Zürich

On-site
CHF 140,000 - 240,000
International research environment in 
European research collaboration
Top locations