Multimodal AI Algorithm Expert-EMG / Interaction Perception, Pico San Jose Regular

Bytedance; San Jose (CA); Hybrid; USD 218,000 - 480,000; Full time

Benefits offered by this job

Health insurance

401(k) with company match

Parental leave

Job summary

ByteDance’s Pico team in San Jose is seeking a Multimodal AI Algorithm Expert-EMG / Interaction Perception to advance sEMG-vision-IMU fusion for AR/VR interaction. You will drive research and build robust models across multimodal data, including hand tracking, eye tracking, and XR accessories.

The role requires a strong background in deep learning, sEMG signal processing, and 2D/3D perception with a track record of research impact. Competitive compensation and comprehensive benefits are provided.

Qualifications

• Master’s degree or above in machine learning, signal processing, computer science, statistics, speech and language technology, or related field.
• Proficiency in deep learning, training and deploying models; familiarity with 2D/3D perception algorithms.
• Experience with sEMG signal acquisition/processing, denoising, and feature extraction.
• Experience with digital signal processing techniques: filtering, Fourier transforms, correlations, modulation.

Responsibilities

• Research and develop deep learning models intersecting sEMG, computer vision and IMU.
• Design sEMG signal acquisition pipelines, optimize signal quality and preprocess data.
• Explore spatiotemporal feature fusion methods for multimodal data fusion.
• Handle sensor noise, optimize model performance and generalization.

Skills

Deep learning fundamentals

sEMG signal processing

Multimodal fusion (Transformer/LSTM)

Computer vision algorithms

Education

Master’s degree or above in ML/Signal Processing/CS/Statistics/SLT

Job description

Multimodal AI Algorithm Expert-EMG / Interaction Perception, Pico

Location:

San Jose

Team:

Technology

Employment Type:

Regular

Job Code:

A178471A

Responsibilities

About the TeamThe team at PICO is dedicated to leverage technologies such as computer vision, deep learning, SLAM, 3D reconstruction, and multi-sensor fusion, we continuously expand the ways humans interact with the virtual world through handheld controllers, bare-hand tracking, eye-tracking, and XR interactive accessories, enhancing the overall interaction experience.

• 1. Research and develop innovative deep learning models with a focus on the intersection of surface electromyography (sEMG), computer vision, and IMU technologies；
• 2. Design and implement sEMG signal acquisition pipelines, optimize signal quality, and perform data preprocessing tasks such as denoising and feature extraction；
• 3. Explore spatiotemporal feature fusion methods (e.g., Transformer, LSTM, Spatiotemporal Convolutional Networks) to achieve efficient multimodal data fusion；
• 4. Handle sensor noise and interference in various environments, optimize model performance, and improve the generalization of algorithms

Qualifications

Minimum Qualifications:

• 1. Master’s degree or above in machine learning, signal processing, computer science, statistics, speech and language technology, or a related field；
• 2. Proficient in the fundamentals of deep learning, with substantial experience in training and deploying deep models. Experience in fine-tuning end-to-end speech recognition frameworks (e.g., Conformer, RNN-T, LAS, CTC) and familiarity with 2D/3D perception algorithms in computer vision.；
• 3. Familiarity with sEMG signal acquisition and processing, including signal denoising (e.g., filtering algorithms) and feature extraction (e.g., time-domain and frequency-domain features)；
• 4. Experience with common digital signal processing techniques, such as digital filtering, Fourier transforms, correlation analysis, and modulation.

Preferred Qualifications

• 1. Experience in analyzing and modeling high-dimensional time-series data, such as speech signals, neural signals, physiological signals, videos, or other sensor data.
• 2. Publications in accredited academic conferences (e.g., CVPR, ICCV, ECCV) or participation in competitions like Kaggle, COCO, ImageNet, ActivityNet, and 3D-related challenges.

Job Information

The base salary range for this position in the selected city is $218400 - $480000 annually.

Compensation may vary outside of this range depending on a number of factors, including a candidate’s qualifications, skills, competencies and experience, and location. Base pay is one part of the Total Package that is provided to compensate and recognize employees for their work, and this role may be eligible for additional discretionary bonuses/incentives, and restricted stock units.

Benefits may vary depending on the nature of employment and the country work location. Employees have day one access to medical, dental, and vision insurance, a 401(k) savings plan with company match, paid parental leave, short-term and long-term disability coverage, life insurance, wellbeing benefits, among others. Employees also receive 10 paid holidays per year, 10 paid sick days per year and 17 days of Paid Personal Time (prorated upon hire with increasing accruals by tenure).

The Company reserves the right to modify or change these benefits programs at any time, with or without notice.

For Los Angeles County (unincorporated) Candidates:

Qualified applicants with arrest or conviction records will be considered for employment in accordance with all federal, state, and local laws including the Los Angeles County Fair Chance Ordinance for Employers and the California Fair Chance Act. Our company believes that criminal history may have a direct, adverse and negative relationship on the following job duties, potentially resulting in the withdrawal of the conditional offer of employment:

1. Interacting and occasionally having unsupervised contact with internal/external clients and/or colleagues;

2. Appropriately handling and managing confidential information including proprietary and trade secret information and access to information technology systems; and

3. Exercising sound judgment.

About Pico

Founded in April 2015, Pico is a VR company committed to developing immersive and interactive VR experiences for people around the world. Pico also provides tailor-made solutions for our enterprise clients in the fields of education and healthcare.

Why Join ByteDance

Inspiring creativity is at the core of ByteDance's mission. Our innovative products are built to help people authentically express themselves, discover and connect – and our global, diverse teams make that possible. Together, we create value for our communities, inspire creativity and enrich life - a mission we work towards every day.

As ByteDancers, we strive to do great things with great people. We lead with curiosity, humility, and a desire to make impact in a rapidly growing tech company. By constantly iterating and fostering an "Always Day 1" mindset, we achieve meaningful breakthroughs for ourselves, our Company, and our users. When we create and grow together, the possibilities are limitless. Join us.

Diversity & Inclusion

ByteDance is committed to creating an inclusive space where employees are valued for their skills, experiences, and unique perspectives. Our platform connects people from across the globe and so does our workplace. At ByteDance, our mission is to inspire creativity and enrich life. To achieve that goal, we are committed to celebrating our diverse voices and to creating an environment that reflects the many communities we reach. We are passionate about this and hope you are too.

Reasonable Accommodation

ByteDance is committed to providing reasonable accommodations in our recruitment processes for candidates with disabilities, pregnancy, sincerely held religious beliefs or other reasons protected by applicable laws. If you need assistance or a reasonable accommodation, please reach out to us at https://tinyurl.com/RA-request