AI Researcher - Perception

1X; San Carlos (AZ); On-site; USD 200,000 - 300,000; Full time

Benefits offered by this job

Health coverage

PTO - paid time off

401(k) with company match

FSA/HSA options

Commuter benefits

Disability & life insurance

Employee Assistance Program (EAP)

Onsite snacks and catered lunches

Job summary

1X is building humanoid home robots like NEO to safely perform tasks and free people’s time. This role leads perception development from prototype to fleet deployment, delivering geometry, pose, and scene reconstruction capabilities with tight sensor fusion.

You will push state-of-the-art perception, calibrate cameras automatically on a production line, and measure improvements with real-world robotics data. A strong background in geometric vision and PyTorch is essential.

Qualifications

• Shipping perception systems on real robots.
• Training, evaluating, and deploying deep learning models in PyTorch.
• Geometric vision, camera calibration (intrinsics/extrinsics).
• End-to-end ownership from problem definition through deployment.
• Strong Python and modern C++ with robust testing and code review.

Responsibilities

• Own perception for NEO from prototype to fleet deployment.
• Develop vision systems to measure geometry, recover pose, and reconstruct terrain and scenes.
• Deliver pose estimation models for labeling and motion generation.
• Fuse data from cameras and inertial sensors for consistent downstream data.
• Automate camera calibration on the production line and monitor drift across fleet.
• Establish datasets and metrics to show perceptual improvements on real robots.

Skills

Geometric vision

Python

Modern C++

Pose estimation

Deep learning (PyTorch)

Camera calibration

Perception systems

Production ML

SLAM/VIO

End-to-end ownership

Education

Advanced degree in a relevant field

Tools

PyTorch

Job description

About 1X

We're building humanoid robots that work in home - doing the chores, handling the tasks, and giving people their time back. Simple, but it's not.

To do this right, we have to solve robotics, AI, manufacturing - at the same time, at scale, in a form factor that has to be safe enough to live with your family. If you're inspired by this, you'll thrive here. We've been at this since 2014 and we're at the point where the hard problems are behind us and the hard work is in front of us.

NEO is our flagship - a home robot designed to move, learn, and operate in the real world alongside real people. We're not demoing it - we're shipping it. We're excited to meet you, if this excites you.

If you've spent your career working on problems that matter and want to see them actually reach the world - this is that moment. We're scaling, we're hiring with intention, and we need people who want to build something that will genuinely change how humans spend their time - safely creating abundance for all.

About the Team

The Motion team enables NEO to move through and interact with the world. We build the perception NEO needs to understand its surroundings and locomote through any environment, and the control that lets it use its whole body to accomplish real tasks - crawling, bracing, climbing, lifting with more than just its arms. Because NEO operates around people, safe and compliant motion is a design constraint on everything we ship, not a feature layered on top.

Your Charter

Own perception for NEO from first prototype to fleet-wide deployment. You will build the vision systems that measure the robot's own geometry, recover human and object pose, and reconstruct the terrain and scenes NEO has to walk through and work in. How precisely NEO places a hand or plans a step is bounded by the perception you deliver, and you will measure your impact on deployed robots rather than on benchmarks.

Key Outcomes

• Kinematic Calibration: Recover each robot's true geometry from camera data so controls and learned policies act on an accurate model of the body they drive.

• 3D Scene Understanding: Deliver depth and scene reconstruction accurate enough to drive terrain-aware locomotion and contact-rich manipulation.

• Pose Estimation: Ship human & object pose estimation models that can be used for large scale data labelling efforts and human/robot motion generation models.

• Sensor Fusion: Drive time synchronization and fusion across cameras and inertial sensors so every downstream consumer gets spatially and temporally consistent data.

• Calibration at Scale: Own intrinsic and extrinsic camera calibration - automated on the production line, monitored for drift across the fleet, and recoverable through field tools.

• Evaluation: Establish the datasets and metrics that show whether a perception change improved robot behavior, not just an offline score.

Key Competencies

• Geometric Vision: Fluent in camera models, multi-view geometry, and non-linear optimization; reaches for classical or learned methods based on the problem.

• Production ML: Trains and ships modern vision models, including transformer backbones, generative approaches, and learned depth, and makes them fast and predictable on embedded compute.

• Hardware Grounding: Treats sensor noise, timing, and calibration drift as first-class problems, and traces how each propagates into a control loop or policy rollout.

• Prototype to Production: Stands up a new capability from a paper and a test rig, then makes it repeatable across a fleet and monitored in the field.

• Technical Direction: Sets the approach for a problem area, defends tradeoffs across sensing, models, and compute budget, and stays hands‑on.

Minimum Requirements

• Proven track record of shipping perception systems that run on physical hardware in the real world - robotics experience welcome but not required

• Demonstrated ability to train, evaluate, and deploy deep learning models for detection, depth, or pose estimation in PyTorch

• Deep experience with geometric computer vision, camera-based kinematic calibration (hand-eye / foot-eye calibration), and camera calibration including intrinsics & extrinsics

• Experience owning a capability end to end, from problem definition through deployment and iteration on real failures

• Strong Python and modern C++ in large shared codebases, with solid testing and code review practices

• 5+ years of relevant industry experience, or an advanced degree plus equivalent hands‑on experience

Preferred Skills

• Experience with visual‑inertial odometry or SLAM, including multi-sensor time synchronization and fusion

• Familiarity with robot kinematics and frame transforms, and how calibration error shows up in manipulation and locomotion

• Experience building and adapting segmentation and classification models, including fine‑tuning open‑vocabulary or foundation backbones for a specific domain

• Experience reconstructing scenes and terrain from video using differentiable rendering, neural rendering, or Gaussian splatting

• Exposure to automating calibration and validation in manufacturing, or to building field diagnostic tools for deployed hardware

• Familiarity with sensing beyond RGB such as radar, thermal, or near‑infrared

Compensation

• Salary Range: $200,000 - $300,000 + Equity

Benefits

• Comprehensive medical, dental, and vision coverage

• Generous paid time off, company holidays, and parental leave

• 401(k) plan with company match (100% on the first 3% of contributions, 50% on the next 2%)

• Flexible Spending Accounts (FSA) and Health Savings Accounts (HSA) options

• Commuter benefits (transit and parking)

• Short-term and long-term disability, and life insurance

• Employee Assistance Program (EAP) for mental health, financial, and personal support

• Onsite snacks and catered lunches

Equal Opportunity Employer

1X is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, gender, gender identity or expression, sexual orientation, national origin, ancestry, citizenship, age, marital status, medical condition, genetic information, disability, military or veteran status, justice system impact, or any other characteristic protected under applicable federal, state, or local law.