Computer Vision Engineer - Body Sensor Networks

Xsens; United States; Hybrid; USD 120,000 - 180,000; Full time

Benefits offered by this job

28 vacation days

Work from home

Flexible working hours

Volunteer time

Financial planning

Social events

Job summary

Xsens is seeking a Computer Vision Engineer to lead camera‑based perception for motion capture. You will establish deep learning and computer vision pipelines to turn camera images into human pose estimates and report to the Technology Manager.

The role is open to hybrid or remote working, requiring a strong background in CV, robotics or sensor fusion. You will collaborate with a talented team and work on cutting-edge perception challenges at Xsens.

Qualifications

• MSc/PhD in Computer Science, Electrical Engineering, Robotics or a related field.
• Hands-on experience training and fine-tuning deep learning models for human pose estimation.
• Solid understanding of camera and lens models, calibration, and multi-view geometry.

Responsibilities

• Lead camera-based perception for Xsens motion capture and build DL pipelines for pose estimation.
• Develop camera calibration routines for varied camera configurations and lens types.
• Evaluate motion capture output and implement compensation for vision failure modes.
• Create training/evaluation pipelines using camera and optical motion capture data.

Skills

Python

C++

Deep learning

Education

MSc/PhD in Computer Science, Electrical Engineering, Robotics

Tools

OpenCV

Sapiens

SAM3D

Job description

Do you get excited about building cutting-edge perception systems that work reliably in the real world? Do you have a strong foundation in computer vision, robotics, or sensor fusion? Are you interested in shaping new technology capabilities within a growing and innovative high-tech company, where people and fun are part of our core values? We'd love to have you! Who is Xsens Xsens is a leading full-stack provider of sensors, software, and analytics that enable the digitization of movement. Xsens serves entertainment, humanoid robotics, health & sports and automation & mobility markets. By turning complex motion data into actionable insight, we help our partners accelerate development, improve control and learning, and bring physically intelligent systems to life. We collaborate with leading global innovators including Boston Dynamics, Toyota, Siemens, Electronic Arts, Epic Games, Netflix, and 20th Century Studios, alongside more than 1,000 research institutions, humanoid robotics companies and universities worldwide.

Computer Vision Engineer at Xsens

As a Computer Vision Engineer, you will lead camera-based perception for Xsens motion capture. Your role is to establish Deep Learning and Computer Vision pipelines to turn camera images into human pose estimate. You will learn from the highly-skilled team of sensor fusion experts, biomechanists and mathematicians. You will be its computer vision specialist, and report to the Technology Manager. The position is open to hybrid / remote working.

Key challenges

• Select, adapt and fine-tune deep learning models for 2D and 3D human pose estimation from cameras, that perform robustly in challenging real-world conditions.
• Develop camera models and calibration routines for a range of camera and lens configurations.
• Evaluation of motion capture output and developing compensatory algorithms and techniques to handle camera /vision failure modes.
• Build training and evaluation pipelines from camera and optical motion capture recordings.
• Use synthetic data where real data is insufficient.
• Track the computer vision research landscape and assess whether new techniques are feasible for Xsens products.

Requirements

• Required MSc/PhD in Computer Science, Electrical Engineering, Robotics or a related field, with years of relevant industry or applied research experience.
• Hands-on experience training and fine-tuning deep learning models for human pose estimation, with results evaluated on public benchmarks.
• Solid understanding of camera and lens models, including wide field-of-view optics, intrinsic and extrinsic calibration, and multi-view geometry.
• Familiarity with the output representations of common pose models, such as keypoint sets and SMPL-family parameters.
• Experience with tools in markerless eco-system such as OpenCV, Sapiens, and SAM3D.
• Proficiency in Python.
• Working knowledge of C++ for integrating models into an existing C++ codebase.
• Preferred Experience with synthetic data generation and rendering pipelines.
• Experience optimizing models for real-time deployment, for example with ONNX, TensorRT or quantization.
• Experience building datasets and benchmarks for human motion.

Working at Xsens

We value ingenious ideas, no matter where they come from. We believe diverse thoughts, voices, and backgrounds make us stronger as a company. We know that it is through collaboration with people from all walks of life that we make the most positive impact as an organization. Join Xsens ' innovative, ambitious, and international team, where your ideas and talents make an impact.

Along with a competitive compensation package, we offer a range of benefits designed to support your well-being and help you thrive.

Benefits

• 28 paid vacation days with an option to buy, sell, or carry over days, giving you flexibility to manage your time off as appropriate to your situation
• Tax perks for your sports memberships and bicycle purchase; so staying active is easier than ever.
• Flexible working hours and the option to work from home, helping you balance life and work
• Paid volunteer time: Through our partnership with Stichting Present, you have the opportunity to give back to the community during office hours
• Our partnership with Equip gives you on-demand access to a dedicated financial planner who provides clear guidance and a concrete plan for wealth building, pensions, and major life events.
• Enjoy company social events as well as fun, informal activities organized by our staff association.
• From movie nights and sports clinics to cooking classes and LAN parties, there's always something happening to connect and have fun