Research Scientist Intern - Multimodal Sensing & On-Device Perception - Global Frontier Tech Re[...]

Socket.dev; San Jose (CA); On-site; USD 64,747 - 86,788; Part time

Job summary

ByteDance in San Jose is seeking a Research Scientist Intern for Multimodal Sensing & On-Device Perception. You will research and prototype image-sensor based sensing for wearable form factors, focusing on low-power, always-on operation.

You will design and train ML models using computer vision and language modeling to interpret complex spatio-temporal data, and explore on-device compute and hardware/software co-design to meet power targets.

Qualifications

• Pursuing a PhD in a technical field.
• Strong research background in computer vision and machine learning with hands-on model training.
• Experience with sequence modeling, language modeling, efficient neural network design, or signal processing.

Responsibilities

• Research, prototype, and evaluate novel image sensor‑based sensing approaches for a wearable form factor, with an emphasis on low‑power, always‑on operation.
• Design and train machine learning models, utilizing computer vision and language modeling to interpret complex spatio‑temporal data.
• Design and run simulations to assess performance across representative operating conditions.
• Explore hardware/software co‑design opportunities, including on‑sensor or near‑sensor compute to meet power targets.
• Build end‑to‑end hardware prototypes by integrating image sensors, optics, and structured light components.

Skills

Computer vision

Machine learning

Sequence modeling

Language modeling

Education

PhD in Computer Science / Electrical Engineering / Optical Engineering / Applied Mathematics / Physics

Tools

Hardware prototyping

Job description

Research Scientist Intern - Multimodal Sensing & On-Device Perception

Location: San Jose

Team: Technology

Employment Type: Intern

Responsibilities

• Research, prototype, and evaluate novel image sensor‑based sensing approaches for a wearable form factor, with an emphasis on low‑power, always‑on operation.
• Design and train machine learning models, utilizing computer vision and language modeling to interpret complex spatio‑temporal data.
• Design and run simulations to assess performance across representative operating conditions.
• Explore hardware/software co‑design opportunities, including on‑sensor or near‑sensor compute to meet power targets.
• Build end‑to‑end hardware prototypes by integrating image sensors, optics, and structured light components.

Qualifications

Minimum Qualifications:

• Currently pursuing a PhD in Computer Science, Electrical Engineering, Optical Engineering, Applied Mathematics, Physics, or a related technical field.
• Strong research background in computer vision and machine learning, with hands‑on model training experience.
• Experience with at least one of: sequence modeling, language modeling, efficient neural network design, or signal processing.

Preferred Qualifications:

• Proven track record of high‑impact research, demonstrated by publications in CVPR, ICCV, ECCV, NeurIPS, ICLR, SIGGRAPH, or similar.
• Hands‑on experience with hardware prototyping involving cameras, structured light, or other active sensing systems.
• Familiarity with on‑device or on‑sensor compute, embedded ML deployment, and hardware/software co‑design tradeoffs.
• Self‑motivated, curious, and excited about taking ambitious research ideas from prototype to working system.

Job Information

The hourly rate range for this position in the selected city is $55- $55.

Benefits may vary depending on the nature of employment and the country work location. Interns have day one access to health insurance, life insurance, wellbeing benefits and more. Interns also receive 10 paid holidays per year and paid sick time (56 hours if hired in first half of year, 40 if hired in second half of year). Interns who are not working 100% remote may also be eligible for housing allowance.

The Company reserves the right to modify or change these benefits programs at any time, with or without notice.

EEO Statement

For Los Angeles County (unincorporated) Candidates:

1. Interacting and occasionally having unsupervised contact with internal/external clients and/or colleagues;
2. Appropriately handling and managing confidential information including proprietary and trade secret information and access to information technology systems;
3. Exercising sound judgment.

Reasonable Accommodation

ByteDance is committed to providing reasonable accommodations in our recruitment processes for candidates with disabilities, pregnancy, sincerely held religious beliefs or other reasons protected by applicable laws. If you need assistance or a reasonable accommodation, please reach out to us at https://tinyurl.com/RA-request