Research Scientist - Intern (Video and Edge, Multimedia Lab) - 2027 Start (PhD) PhD Intern - 2027 Start San Jose

Bytedance

San Jose (CA)

On-site

USD 68,000 - 97,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Health insurance
Paid holidays
Paid sick time
Housing allowance (non-remote)

Job summary

ByteDance Research Intern (Video and Edge, Multimedia Lab) in San Jose offers hands-on research in multimedia. The role covers multimodal video understanding, quality assessment, and dataset work, with pathways to production-scale silicon and software systems.

PhD candidates participate in a dynamic internship blending learning, collaboration, and innovation with real-world impact. The team explores efficient multimodal models, video coding strategies, and perceptual quality measures, aiming to

Qualifications

  • Pursuing a PhD in Computer Science, Computer Engineering, Electrical Engineering, or a related technical discipline.
  • Strong foundations in machine learning and computer vision with research or project experience in multimodal learning, video understanding, image/video quality assessment, or video processing.
  • Proficiency in Python and hands-on experience with PyTorch or TensorFlow.
  • Ability to design experiments, implement research ideas, analyze results, and communicate technical findings clearly.
  • Familiarity with Transformer architectures, vision-language models, or MLLMs; hands-on experience with model training, fine-tuning, inference, or evaluation.
  • Experience in long-video understanding, temporal grounding, spatiotemporal reasoning, video QA, or cross-modal alignment.
  • Experience in quality assessment, perceptual modeling, or explainable analysis of visual and temporal degradations.
  • Familiarity with supervised fine-tuning, parameter-efficient fine-tuning (LoRA), or data-efficient learning methods.
  • Familiarity with video enhancement and compression including super-resolution, denoising, diffusion models, or content-aware encoding.

Responsibilities

  • Research and prototype multimodal models for video understanding, including temporal reasoning, event localization, temporal grounding, region-of-interest detection, and salient object detection.
  • Develop video quality assessment methods that identify and explain spatial and temporal degradations, and investigate how semantic context and user preferences affect perceived quality.
  • Contribute to dataset and benchmark development, including data curation, annotation design, evaluation protocols, and analysis of model accuracy, robustness, and generalization.
  • Explore efficient adaptation and inference of multimodal foundation models for video tasks, such as supervised fine-tuning, parameter-efficient adaptation, frame selection, and visual token compression.
  • Work with researchers and engineers to connect video understanding and quality assessment with enhancement and encoding strategies; evaluate prototypes through offline experiments and, where applicable, production validation and A/B testing.

Skills

Video understanding
Multimodal learning
Python
PyTorch
TensorFlow
C/C++

Education

PhD student in CS/CE/EE

Tools

Linux
OpenCV
FFmpeg

Job description

Research Scientist - Intern (Video and Edge, Multimedia Lab) - 2027 Start (PhD)

Location: San Jose

Team: Technology

Employment Type: Intern

Job Code: A247375A

Responsibilities

The Multimedia Lab builds highly efficient, scalable video codec hardware solutions (FPGA and ASIC) from the ground up, serving billions of users. We bring together algorithm, architecture, software, firmware, and hardware design and verification expertise, designing high-performance video silicon IP across ASIC and SoC digital design, verification, and next-generation video codec hardware. Alongside the silicon work, we advance research in video understanding, perceptual quality assessment, image and video enhancement, and intelligent coding, including using multimodal models to improve coding decisions. Quality, efficiency, and speed rarely improve together. Sharper images and better perceived quality usually cost bitrate, compute, or latency, and a technique that works in research does not always survive production at global scale. You will take ideas from research through to silicon and production systems, where research decisions show up in the cost and quality of video across ByteDance's products. Explore how multimodal large language models (MLLMs) can understand video content, reason over events across time, and assess perceptual quality. Research may cover long-video understanding, temporal and spatial grounding, interpretable quality assessment, user-aligned video enhancement, and content-aware processing and compression. We are looking for talented individuals to join us for an internship. PhD internships at Our Company provide students with the opportunity to actively contribute to our products and research, as well as to the organization's future plans and emerging technologies. Our dynamic internship experience blends hands‑on learning, enriching community-building and professional development events, and collaboration with industry experts. Applications will be reviewed on a rolling basis, so we encourage you to apply early. Please clearly state your availability in your resume (Start date, End date).

  • Research and prototype multimodal models for video understanding, including temporal reasoning, event localization, temporal grounding, region‑of‑interest detection, and salient object detection.
  • Develop video quality assessment methods that identify and explain spatial and temporal degradations, and investigate how semantic context and user preferences affect perceived quality.
  • Contribute to dataset and benchmark development, including data curation, annotation design, evaluation protocols, and analysis of model accuracy, robustness, and generalization.
  • Explore efficient adaptation and inference of multimodal foundation models for video tasks, such as supervised fine‑tuning, parameter‑efficient adaptation, frame selection, and visual token compression.
  • Work with researchers and engineers to connect video understanding and quality assessment with enhancement and encoding strategies; evaluate prototypes through offline experiments and, where applicable, production validation and A/B testing.
Qualifications
  • Currently pursuing a PhD in Computer Science, Computer Engineering, Electrical Engineering, or a related technical discipline.
  • Strong foundations in machine learning and computer vision, with research or project experience in at least one of the following: multimodal learning, video understanding, image/video quality assessment, or video processing.
  • Proficiency in Python and hands‑on experience with a deep learning framework such as PyTorch or TensorFlow.
  • Ability to design experiments, implement research ideas, analyze results, and communicate technical findings clearly.
  • Familiarity with Transformer architectures, vision‑language models, or MLLMs; hands‑on experience with model training, fine‑tuning, inference, or evaluation.
  • Experience in long‑video understanding, temporal grounding, spatiotemporal reasoning, video question answering, or cross‑modal alignment.
  • Experience in subjective/objective quality assessment, perceptual modeling, or explainable analysis of visual and temporal degradations.
  • Familiarity with supervised fine‑tuning, parameter‑efficient fine‑tuning (e.g., LoRA), preference alignment, or data‑efficient learning methods.
  • Familiarity with video enhancement and compression, including super‑resolution, denoising, diffusion models, or content‑aware encoding.
  • Experience with Linux, OpenCV, FFmpeg, distributed data processing, or GPU‑based model training; proficiency in C/C++ is a plus.
  • Evidence of research capability through publications, open‑source contributions, or substantive research projects, and an interest in translating research into practical multimedia applications.
Job Information

The hourly rate range for this position in the selected city is $60- $60.

Benefits
  • Interns have day one access to health insurance, life insurance, wellbeing benefits and more.
  • Interns also receive 10 paid holidays per year and paid sick time (56 hours if hired in first half of year, 40 if hired in second half of year).
  • Interns who are not working 100% remote may also be eligible for housing allowance.
  • The Company reserves the right to modify or change these benefits programs at any time, with or without notice.
For Los Angeles County (unincorporated) Candidates
  1. Interacting and occasionally having unsupervised contact with internal/external clients and/or colleagues;
  2. Appropriately handling and managing confidential information including proprietary and trade secret information and access to information technology systems;
  3. Exercising sound judgment.
About Us

Founded in 2012, ByteDance's mission is to inspire creativity and enrich life. With a suite of more than a dozen products, including TikTok, Lemon8, CapCut and Pico as well as platforms specific to the China market, including Toutiao, Douyin, and Xigua, ByteDance has made it easier and more fun for people to connect with, consume, and create content.

Why Join ByteDance

Inspiring creativity is at the core of ByteDance's mission. Our innovative products are built to help people authentically express themselves, discover and connect – and our global, diverse teams make that possible. Together, we create value for our communities, inspire creativity and enrich life - a mission we work towards every day.

As ByteDancers, we strive to do great things with great people. We lead with curiosity, humility, and a desire to make impact in a rapidly growing tech company. By constantly iterating and fostering an "Always Day 1" mindset, we achieve meaningful breakthroughs for ourselves, our Company, and our users. When we create and grow together, the possibilities are limitless. Join us.

Diversity & Inclusion

ByteDance is committed to creating an inclusive space where employees are valued for their skills, experiences, and unique perspectives. Our platform connects people from across the globe and so does our workplace. At ByteDance, our mission is to inspire creativity and enrich life. To achieve that goal, we are committed to celebrating our diverse voices and to creating an environment that reflects the many communities we reach. We are passionate about this and hope you are too.

Reasonable Accommodation

ByteDance is committed to providing reasonable accommodations in our recruitment processes for candidates with disabilities, pregnancy, sincerely held religious beliefs or other reasons protected by applicable laws. If you need assistance or a reasonable accommodation, please reach out to us at https://tinyurl.com/RA-request

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Research Scientist - Intern (Video and Edge, Multimedia Lab) - 2027 Start
Research Scientist - Intern (Video and Edge, Multimedia Lab) - 2027 Start

ByteDance • San Diego (CA)

On-site
USD 65,000 - 92,000
Research Scientist - Intern (Video and Edge, Multimedia Lab) - 2027 Start Undergraduate/Master Intern - 2027 Start San Diego
Research Scientist - Intern (Video and Edge, Multimedia Lab) - 2027 Start Undergraduate/Master Intern - 2027 Start San Diego

Bytedance • San Diego (CA)

On-site
USD 65,000 - 92,000
Health insurance
Life insurance
Wellbeing benefits
+3
Research Scientist - Graduate (Video and Edge, Multimedia Lab) - 2027 Start (PhD)
Research Scientist - Graduate (Video and Edge, Multimedia Lab) - 2027 Start (PhD)

ByteDance • San Jose (CA)

On-site
USD 128,000 - 317,000
Research Scientist New Grad - Video and Edge - Multimedia Lab
Research Scientist New Grad - Video and Edge - Multimedia Lab

ByteDance • San Jose (CA)

On-site
USD 128,000 - 317,000
Video/Image AI/ML Software Engineer Intern (Multimedia) - 2027 Start (PhD)
Video/Image AI/ML Software Engineer Intern (Multimedia) - 2027 Start (PhD)

ByteDance • San Diego (CA)

On-site
USD 65,000 - 92,000
Health insurance from day one
Housing allowance
Research Scientist Graduate (Multimedia Standards) - Global Frontier Tech Recruitment Program - 2027 Start (PhD)
Research Scientist Graduate (Multimedia Standards) - Global Frontier Tech Recruitment Program - 2027 Start (PhD)

ByteDance • San Diego (CA)

On-site
USD 207,000 - 456,000
Medical, dental, and vision insurance
401(k) with company match
Paid parental leave
+6
Video/Image AI/ML Software Engineer - Graduate (Video and Edge, Multimedia Lab) - 2027 Start (PhD)
Video/Image AI/ML Software Engineer - Graduate (Video and Edge, Multimedia Lab) - 2027 Start (PhD)

ByteDance • San Jose (CA)

On-site
USD 128,000 - 317,000
Research Intern (AML) - 2026 Start (PhD)
Research Intern (AML) - 2026 Start (PhD)

ByteDance • San Jose (CA)

Hybrid
USD 68,000 - 97,000
Health insurance
Housing allowance
Paid holidays and sick time
Research Scientist Intern (Multi-modal Agentic Databases) - 2027 Start (PhD)
Research Scientist Intern (Multi-modal Agentic Databases) - 2027 Start (PhD)

ByteDance • Seattle (WA)

On-site
USD 65,000 - 92,000
Health insurance on day one
10 paid holidays per year
Housing allowance if not remote
Research Intern (AI Compute) - 2027 Start (PhD)
Research Intern (AI Compute) - 2027 Start (PhD)

ByteDance • San Jose (CA)

On-site
USD 70,000 - 95,000
Health insurance
Life insurance
Wellbeing benefits
+2