Machine Learning Engineer (Egocentric 3D Human Pose)

Glint Tech Solutions LLC

United States

Remote

USD 120,000 - 180,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Competitive salary and equity package
Medical, dental, and vision insurance
401(k) retirement plan
Generous paid time off and holidays
Paid sick leave
Collaborative research environment
Opportunity to work with leading robot

Job summary

Glint Tech Solutions LLC seeks a Machine Learning Engineer to advance 3D body and hand motion reconstruction from egocentric video. You’ll develop models and pipelines for monocular and stereo systems, including SMPL/SMPL-X and MANO, and drive scalable deployment.

Role spans calibration, data annotation, model training, evaluation, and large-scale deployment with robotics colleagues to produce high-quality robot training data. Strong CV/vision and DL background required.

Qualifications

  • PhD or Master’s in CS/ML/CV/Robotics or related field.
  • 3+ years experience building ML systems for perception.
  • Hands-on 3D pose/motion tracking from video required.

Responsibilities

  • Develop state-of-the-art 3D body and hand pose estimation models for egocentric video.
  • Build models for 2D/3D keypoint estimation, SMPL/SMPL-X, MANO, and full-body motion reconstruction.
  • Address severe self-occlusion, motion blur, and challenging egocentric vision problems.
  • Design and maintain camera geometry and calibration pipelines including stereo calibration.
  • Improve temporal consistency and fusion via multi-view and multi-modal data.
  • Create scalable annotation, evaluation, and QA pipelines for large datasets.
  • Optimize training and inference pipelines for production environments.
  • Collaborate with robotics engineers to convert motion into robot training data.

Skills

3D pose estimation
Python
PyTorch or TensorFlow
multi-view geometry
camera calibration
3+ years ML systems

Education

Bachelor's/Master's/PhD in CS/ML/CV/Robotics

Tools

PyTorch
TensorFlow

Job description

About the Role

We are looking for a Machine Learning Engineer to join our core research and development team focused on recovering accurate 3D human body and hand motion from egocentric (first-person) video. Human demonstration data is the foundation of robot learning, and its quality depends on accurately reconstructing human motion. In this role, you will develop models and production pipelines that transform head-mounted and body-mounted camera streams—including wide-FOV, stereo, motion-blurred, and heavily self-occluded video—into metrically accurate, temporally consistent 3D pose representations for robot policy training and human-to-robot motion retargeting. You will work across the entire perception stack, including camera calibration, data annotation, model training, evaluation, and large-scale deployment. This role is ideal for engineers with strong expertise in both computer vision and deep learning who enjoy solving challenging real-world perception problems.

Responsibilities
  • Develop state-of-the-art 3D body and hand pose estimation models for egocentric video using monocular and stereo camera systems.
  • Build models for 2D/3D keypoint estimation, SMPL/SMPL-X, MANO, and full-body motion reconstruction.
  • Address challenging egocentric vision problems, including severe self-occlusion, motion blur, rolling shutter artifacts, truncated limbs, extreme viewpoints, and hand-object interaction.
  • Design and maintain camera geometry and calibration pipelines, including fisheye and wide-FOV camera models, stereo calibration, triangulation, and coordinate frame alignment.
  • Improve temporal consistency and physical plausibility using filtering, kinematic constraints, multi-view fusion, and multi-modal sensor integration.
  • Build scalable annotation, evaluation, and quality assurance pipelines for large-scale human motion datasets.
  • Optimize large-scale model training and high-throughput inference pipelines for production environments.
  • Collaborate closely with robotics engineers to convert reconstructed human motion into high-quality robot training data.
  • Contribute to system architecture, engineering best practices, and the long-term evolution of the perception platform.
Minimum Qualifications
  • Bachelor's, Master's, or PhD in Computer Science, Machine Learning, Computer Vision, Robotics, or a related field.
  • 3+ years of experience building and deploying machine learning systems.
  • Hands-on experience with 3D human pose estimation, hand pose estimation, or human motion tracking from video.
  • Strong understanding of multi-view geometry, camera calibration, triangulation, coordinate transformations, and projection models.
  • Strong Python programming skills and proficiency with PyTorch or TensorFlow.
  • Solid knowledge of modern deep learning techniques, model training, evaluation, and production ML workflows.
  • Strong analytical and problem-solving skills with the ability to thrive in a fast-paced collaborative environment.
Preferred Qualifications
  • Experience with egocentric perception systems, AR/VR headsets, smart glasses, or wearable capture rigs.
  • Expertise with SMPL, SMPL-X, MANO, inverse kinematics, markerless motion capture, or hand-object pose estimation.
  • Familiarity with egocentric vision datasets and benchmarks.
  • Experience with modern video and 3D learning architectures, including Video Transformers, diffusion-based motion models, or 3D CNNs.
  • Experience building multi-camera capture systems, synchronization, and calibration infrastructure.
  • Experience with human-to-robot motion retargeting, teleoperation, imitation learning, or dexterous manipulation.
  • Experience developing annotation tools, active learning pipelines, or large-scale data quality systems.
  • Publications at leading conferences such as CVPR, ICCV, ECCV, NeurIPS, SIGGRAPH, or 3DV, open-source contributions, or demonstrated impact in applied AI systems.
What We Offer
  • Competitive salary and equity package
  • Comprehensive medical, dental, and vision insurance
  • 401(k) retirement plan
  • Generous paid time off and company holidays
  • Paid sick leave
  • Opportunity to work alongside leading researchers and engineers in robotics, computer vision, and AI
  • High-impact role building cutting-edge perception systems for next-generation robotics
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Member of Technical Staff - Human Modeling & Embodied Intelligence
Member of Technical Staff - Human Modeling & Embodied Intelligence

Stealth AI Startup • Redwood City (CA)

On-site
USD 150,000 - 230,000
Equity share
Health benefits
GPU compute access
Egocentric 3D Pose ML Engineer — Equity & Robotics Impact
Egocentric 3D Pose ML Engineer — Equity & Robotics Impact

Glint Tech Solutions LLC • United States

Remote
USD 120,000 - 180,000
Competitive salary and equity package
Medical, dental, and vision insurance
401(k) retirement plan
+4
Machine Learning Engineer
Machine Learning Engineer

Human Archive • San Francisco (CA)

On-site
USD 120,000 - 160,000
Machine Learning / Computer Vision Engineer
Machine Learning / Computer Vision Engineer

Eka Robotics • Boston (MA)

On-site
USD 130,000 - 190,000
Machine Learning Engineer (Video Understanding & Segmentation)
Machine Learning Engineer (Video Understanding & Segmentation)

Maxinsights • Santa Clara (CA)

On-site
USD 150,000 - 210,000
Health insurance
Vision care
Dental coverage
+4
Machine Learning / Computer Vision Engineer
Machine Learning / Computer Vision Engineer

Eka Robotics • Boston (MA)

On-site
USD 140,000 - 210,000
Research Engineer
Research Engineer

Human Archive • San Francisco (CA)

On-site
USD 100,000 - 140,000
Senior Computer Vision Engineer - Egocentric Perception
Senior Computer Vision Engineer - Egocentric Perception

Frontdoor Defense • Atlanta (GA)

Hybrid
USD 160,000 - 230,000
AI Research Engineer/Scientist - Human Data - Robotics
AI Research Engineer/Scientist - Human Data - Robotics

Moonfire • San Francisco (CA)

On-site
USD 140,000 - 210,000
Relocation sponsorship
Enhanced pension plan
Enhanced holiday & paid leave
+3
Research Scientist – Body Pose Detection
Research Scientist – Body Pose Detection

Mecka • New York (NY)

On-site
USD 150,000 - 200,000