Intelligent Sensing Intern - Low-power Agent Sensing and Computing Systems - Global Frontier Te[...]

ByteDance; San Jose (CA); On-site; USD 62,508 - 89,027; Part time

Benefits offered by this job

Health insurance

Housing allowance

Paid holidays

Paid sick time

Job summary

ByteDance invites PhD candidates to join the Intelligent Sensing Intern program in San Jose for 2027 Start. The project focuses on low-power, high-quality sensing for AR/VR cameras, integrating sensors, image pipelines, and AI models to push energy‑efficient perception.

Expect hands-on hardware‑software collaboration within a dynamic research team. The internship emphasizes cross‑disciplinary work across sensing, processing, and AI agents, with opportunities to contribute to system‑level

Qualifications

• PhD candidate in Electrical Engineering, Physics, Computer Engineering, AI, or a related discipline.
• Strong foundation in imaging, sensor tech, or machine learning / computer vision.
• Hands-on experience with VLM/LLM, world models, or large-scale vision models.

Responsibilities

• Design and prototype sensor/imaging architectures with near-sensor processing or learned compression.
• Characterize end-to-end imaging pipelines from optics to downstream perception models.
• Bridge hardware and algorithm thinking from device level to training workflows.
• Develop or adapt vision models co-optimized with hardware constraints.

Skills

Imaging systems

Sensor technology

Machine learning / CV

VLM/LLM experience

Research publications

Communication in teams

Education

PhD candidate in EE/Physics/CE/AI

Job description

Intelligent Sensing Intern - Low-power Agent Sensing and Computing Systems - Global Frontier Tech Recruitment Program - 2027 Start (PHD)

Location:

San Jose

Team:

Technology

Employment Type:

Intern

Job Code:

A159150

Responsibilities

We are looking for talented individuals to join us for an internship in 2027. PhD Internships at our Company aim to provide students with the opportunity to actively contribute to our products and research, and to the organization's future plans and emerging technologies. PhD internships at our Company provides students with the opportunity to actively contribute to our products and research, and to the organization's future plans and emerging technologies. Our dynamic internship experience blends hands‑on learning, enriching community‑building and development events, and collaboration with industry experts. Applications will be reviewed on a rolling basis - we encourage you to apply early. Please state your availability clearly in your resume (Start date, End date). Team Introduction: The VST/camera team focuses on finding low power, high image quality solutions for AR/VR camera systems, including developing CMOS sensors, novel optical/imaging sensors, ultra‑compact camera module technologies, camera lens design, and algorithms. The team is vertically integrating HW/SW for system optimization, shaping the AI experience for the future. Topic Content: The rapid advancement of AI Agents is set to have a far‑reaching and transformative impact on daily life. As the hardware bridge linking AI Agents to the physical world and end users, intelligent hardware acts as a vital gateway for agents to perceive their environment and recognize user intent. Enabling AI Agents to maintain round‑the‑clock environmental awareness and efficiently capture real‑time user intentions is essential to improving their everyday service experience. This topic seeks to overcome the limitations of conventional visual perception systems. By deeply integrating sensing and computing, it explores full‑stack innovation spanning from low‑level hardware to high‑level algorithms. Key efforts include developing next‑generation sensors with real‑time understanding capabilities, investigating non‑traditional visual capture and compression techniques, and designing novel hardware architectures to run advanced algorithms—enabling highly efficient coordination across sensing, processing, and communication. Break free from the framework of conventional sensing systems, explore novel sensors, signal processing and compression schemes to achieve highly energy‑efficient sensing tasks, while enabling seamless integration with large models. Breakthroughs in this research direction will enable intelligent hardware to better connect AI, users, and daily life. Against the backdrop of the AI Agent era, this will unlock the gateway to the next generation of intelligent hardware terminals and open up broader technological possibilities. Project Objective: Rethink visual perception from the sensor up. Instead of treating sensing and computation as separate stages, we're exploring architectures that fuse them — sensors that compress, select, and partially "understand" the scene before data ever leaves the chip. This requires deeply understanding both the hardware constraints and what modern vision‑language and world models actually need from the sensing front‑end. The goal: order‑of‑magnitude gains in perception efficiency by co‑designing hardware and algorithms across the full pipeline.

• Design and prototype novel sensor or imaging architectures that move computation closer to the sensing front‑end (e.g., near‑sensor processing, event‑driven capture, learned compression at the pixel level)
• Build and characterize imaging pipelines end‑to‑end: from optical/sensor physics through ISP to downstream perception models — identify where bits are wasted and where intelligence should be injected
• Leverage understanding of VLM/LLM and world models to inform what information the sensing front‑end must preserve, discard, or transform — closing the loop between foundation model requirements and hardware design
• Develop or adapt machine vision models that are co‑optimized with hardware constraints (power, bandwidth, latency)

Qualifications

Minimum Qualifications

• PhD candidate in field of Electrical Engineering, Physics, Computer Engineering, AI, or a related discipline
• Strong foundation in at least one of: imaging systems, sensor technology, or machine learning / computer vision
• Hands‑on experience with VLM/LLM, world models, or large‑scale vision foundation models, including understanding of data and architectural requirements
• Track record of high impact publication such as Nature, Science, CVPR, ICCV, ECCV, NeurIPS, SIGGRAPH, or equivalent
• Ability to bridge hardware and algorithm thinking — from device‑level concepts to model training workflows
• Strong communication skills with demonstrated ability to collaborate effectively in teams

Preferred Qualifications

• Deep experience working across both hardware (e.g., sensors, imaging pipelines) and software/model development
• Comfortable operating in ambiguous environments with an "explorer mindset"
• Experience with AI‑assisted development tools in research or engineering workflows
• Multidisciplinary project experience and ability to quickly ramp in unfamiliar domains

Job Information

The hourly rate range for this position in the selected city is $55-$55.

Benefits may vary depending on the nature of employment and the country work location. Interns have day one access to health insurance, life insurance, wellbeing benefits and more. Interns also receive 10 paid holidays per year and paid sick time (56 hours if hired in first half of year, 40 if hired in second half of year). Interns who are not working 100% remote may also be eligible for housing allowance.

The Company reserves the right to modify or change these benefits programs at any time, with or without notice.

Equal Opportunity Statement

For Los Angeles County (unincorporated) Candidates: Qualified applicants with arrest or conviction records will be considered for employment in accordance with all federal, state, and local laws including the Los Angeles County Fair Chance Ordinance for Employers and the California Fair Chance Act. Our company believes that criminal history may have a direct, adverse and negative relationship on the following job duties, potentially resulting in the withdrawal of the conditional offer of employment:

1. Interacting and occasionally having unsupervised contact with internal/external clients and/or colleagues;
2. Appropriately handling and managing confidential information including proprietary and trade secret information and access to information technology systems; and
3. Exercising sound judgment.

Reasonable Accommodation

ByteDance is committed to providing reasonable accommodations in our recruitment processes for candidates with disabilities, pregnancy, sincerely held religious beliefs or other reasons protected by applicable laws. If you need assistance or a reasonable accommodation, please reach out to us at https://tinyurl.com/RA-request