AI Algorithm Expert - Hand Tracking, Pico San Jose Regular

ByteDance; San Jose (CA); On-site; USD 208,800 - 438,000; Full time

Benefits offered by this job

Medical, dental, and vision insurance

401(k) with company match

Paid parental leave

Short-term and long-term disability coverage

Life insurance

10 paid holidays per year

10 paid sick days per year

17 days of Paid Personal Time

Job summary

A leading technology company in San Jose is seeking an AI Algorithm Expert specializing in hand tracking technologies. The role involves developing algorithms and models for XR interaction, requiring extensive experience in computer vision and algorithm R&D. The ideal candidate will possess strong skills in PyTorch and optimization techniques, with a competitive salary range of $208,800 - $438,000 a year.

Qualifications

• 5+ years of experience in algorithm R&D is required.
• Familiarity with commercial AR solutions is essential.
• Experience with TensorRT optimization is advantageous.

Responsibilities

• Lead development of hand tracking algorithms for XR scenarios.
• Build a robust 3D gesture pose estimation model.
• Optimize algorithm performance on mobile XR headsets.

Skills

Computer Vision

Pattern Recognition

Applied Mathematics

Algorithm R&D

PyTorch

TensorRT

Education

Degree in Computer Vision, Pattern Recognition or Applied Mathematics

Tools

ARKit Hand Tracking

Quest Hand Tracking

QNN deployment ecosystem

Job description

AI Algorithm Expert - Hand Tracking, Pico

Location: San Jose

Team: Technology

Employment Type: Regular

Job Code: A193113

About the Team

The team at Pico is dedicated to leveraging technologies such as computer vision, deep learning, SLAM, 3D reconstruction, and multi-sensor fusion to continuously expand the ways humans interact with the virtual world through handheld controllers, bare-hand tracking, eye-tracking, and XR interactive accessories, enhancing the overall interaction experience.

Responsibilities

• Lead the development of high-precision and low-latency hand tracking algorithms in XR scenarios, covering directions such as monocular/multiple vision and multi-sensor fusion.
• Build a robust 3D gesture pose estimation model to solve problems of extreme scenarios such as occlusion, fast motion, and complex illumination.
• Optimize real-time inference performance of the algorithm on the mobile XR headset to achieve millimeter-level tracking accuracy.
• Lead the construction of the MultiModal Machine Learning interaction algorithm framework (hand + eye movement + peripheral device) to create a natural XR interaction pattern.
• Promote patent layout and publication of papers in top conferences (CVPR/ICCV/SIGGRAPH, etc.) to enhance the technical influence of the team.

Qualifications

• Minimum: Majored in Computer Vision, Pattern Recognition or Applied Mathematics, with more than 5 years of experience in algorithm R&D.
• Familiar with the technical principles, advantages and disadvantages of commercial solutions such as ARKit Hand Tracking and Quest Hand Tracking.
• Proficient in PyTorch framework and QNN deployment ecosystem, with practical experience in TensorRT end-side optimization.
• Preferred: Experience developing the core algorithm of HandTracking for XR products such as Apple Vision Pro, Meta Reality Labs, and Magic Leap.
• Preferred: Published papers on gesture tracking in top conferences such as CVPR/ICCV/SIGGRAPH.

Compensation

The base salary range for this position in the selected city is $208,800 - $438,000 annually.

Benefits

Employees have day one access to medical, dental, and vision insurance, a 401(k) savings plan with company match, paid parental leave, short-term and long-term disability coverage, life insurance, wellbeing benefits, among others. Employees also receive 10 paid holidays per year, 10 paid sick days per year and 17 days of Paid Personal Time (prorated upon hire with increasing accruals by tenure).

About Pico

Founded in April 2015, Pico is a VR company committed to developing immersive and interactive VR experiences for people around the world. Pico also provides tailor-made solutions for our enterprise clients in the fields of education and healthcare.