3D Machine Learning Engineer

FieldAI; Irvine (CA); On-site; USD 120,000 - 180,000; Full time

Job summary

FieldAI’s Irvine team develops embodied AI with real robots and field deployments. As a 3D Machine Learning Engineer, you will design, train, and maintain cutting-edge models that process 3D point clouds, RGBD, and multi-view data for scene understanding on construction sites.

You will collaborate with software, autonomy, and product teams to ensure seamless integration of these AI models into production environments.

Qualifications

• Bachelor's or Master's in CS/ML/Robotics or related technical field.
• 2+ years hands-on industry experience developing and deploying ML systems for 3D point clouds, perception, or spatial tasks.
• Strong background in 3D ML, including deep learning for point clouds, multi-view fusion, or geometric learning.
• Proficiency in Python and deep learning frameworks (PyTorch, TensorFlow).
• Familiarity with OpenCV and PCL for 3D data preprocessing.
• Experience training and deploying ML models on cloud infrastructure (AWS, SageMaker) and containerized workflows.
• Solid understanding of the end-to-end ML lifecycle: experimentation, reproducibility, versioning, production optimization.
• Ability to work in fast-paced, interdisciplinary teams across software, ML, and product.

Responsibilities

• Design and implement scalable ML pipelines for large-scale 3D spatial data processing (point cloud analysis, segmentation, scene understanding).
• Train, optimize, and deploy deep learning models using PyTorch, TensorFlow, or equivalents on AWS SageMaker or EC2.
• Collaborate with software and systems engineers to integrate models into production and improve inference pipelines.
• Analyze diverse sensor inputs (RGBD, LiDAR, 360 photos, BIM).
• Define robust data annotation strategies with labeling and data ops teams to ensure high performance.

Skills

3D ML

Python

Deep learning

Education

Bachelor's or Master's in CS/ML/Robotics

Tools

OpenCV

PCL

AWS SageMaker

PyTorch / TensorFlow

Job description

FieldAI’s Irvine team is where embodied AI meets real robots, real sensors, and real field deployments. Based in the heart of Southern California’s robotics ecosystem, we build risk-aware, reliable, field-ready AI systems that solve the hardest problems in robotics and unlock the full potential of embodied intelligence. If you want your work to ship, get tested on hardware, and improve through real deployments, Irvine is the place. We go beyond typical data-driven approaches or pure transformer-only architectures, combining rigorous engineering with learning systems proven in globally deployed solutions that deliver results today and get better every time our robots run in the field.

As a 3D Machine Learning Engineer, you will focus on designing, implementing, training, and maintaining cutting-edge 3D and multimodal machine learning models that process reality capture data such as 3D point clouds, 360 photos, and RGBD images. Your work will directly contribute to automated progress tracking, deviation analysis, and semantic scene understanding of construction sites. You will collaborate closely with software, autonomy, and product teams to ensure seamless integration of these AI models into our production environments.

What You’ll Do

• Design and implement scalable machine learning pipelines for large-scale 3D spatial data processing for point cloud analysis, object detection, segmentation, and scene understanding.
• Train, optimize, and deploy deep learning models using PyTorch, TensorFlow, or equivalent frameworks on cloud platforms such as AWS (e.g., SageMaker, EC2).
• Collaborate with software and systems engineers to integrate models into production environments and continuously improve inference pipelines.
• Analyze diverse sensor inputs, including RGBD imagery, LiDAR point clouds, 360 photos, audio, and Building Information Models (BIM).
• Work closely with the labeling and data operations teams to define robust data annotation strategies and ensure high model performance and generalization.

What You Have

• Bachelor's or Master's degree in Computer Science, Machine Learning, Robotics, or a related technical field.
• 2+ years of hands-ons industry experience developing and deploying machine learning systems for 3D point clouds, perception, or spatial understanding tasks.
• Strong background in 3D machine learning, with experience in deep learning for point clouds, multi-view fusion, or geometric learning.
• Strong expertise in Python and deep learning frameworks: PyTorch, TensorFlow, or similar.
• Familiarity with OpenCV and PCL (Point Cloud Library) for classical computer vision and 3D data preprocessing.
• Experience training, evaluating, and deploying ML models using cloud infrastructure (e.g., AWS, SageMaker) and containerized workflows.
• Solid understanding of the end-to-end ML lifecycle, including experiment tracking, reproducibility, model versioning, and optimization for production.
• Proven ability to work in fast-paced, interdisciplinary teams across software, ML, and product teams.

The Extras That Set You Apart

• Experience working with BIM data, digital twins, or construction-related sensor data.
• Background in geometric deep learning, 3D mesh analysis, GIS systems, or structured scene representations.
• Familiar with MLOps pipelines using Ray, SageMaker, MLflow, or Kubeflow.
• Strong foundation in geometric computer vision, robotics, or algorithmic 3D reasoning.
• Exposure to graph neural networks, geodesic computations, or neural implicit representations (e.g., NeRF, Occupancy Networks).
• Deep experience with point cloud and graph learning frameworks such as Open3D-ML, Torch-Points3D, PyG, or MMDetection3D.
• Experience building custom modules for SparseConvNet or 3D transformers.

Our salary range is generous and we consider each individual’s background and experience when determining final compensation. Base pay may vary based on role scope, job-related knowledge, skills, experience, and the Irvine, California market.

Why Join FieldAI in Irvine?

In Irvine, you will work where the robots are. Our local team builds and tests systems on real hardware with real sensors, then ships them to operate in unstructured, previously unknown environments around the world. We are solving one of robotics’ hardest challenges: reliable deployment outside the lab. Our Field Foundational Models raise the bar for perception, planning, localization, and manipulation, with an emphasis on explainability and safety for real-world use.

You will collaborate with a world-class team that thrives on creativity, resilience, and bold thinking. We bring deep experience from organizations such as DeepMind, NASA JPL, Boston Dynamics, NVIDIA, Amazon, Tesla Autopilot, Cruise, Zoox, Toyota Research Institute, and SpaceX, along with a track record of field deployments and strong performance in DARPA challenge segments.

Be Part of the Next Robotics Revolution

We are looking for builders who want their work to leave the whiteboard and show up on robots. If you enjoy tackling tough, uncharted questions and working across disciplines, you will find your people here. Our teams span AI, software, robotics engineering, product, field deployment, and technical communication, all focused on shipping systems that perform in the real world.

Our headquarters is in Irvine, and we partner closely with teams there as well as colleagues across the US and around the world. Join us in Southern California and help define what dependable, field-ready autonomy looks like.

We value diverse perspectives and are committed to fostering an inclusive workplace. We evaluate candidates and employees based on merit, qualifications, and performance, and we do not discriminate on the basis of race, color, gender, national origin, ethnicity, veteran status, disability status, age, sexual orientation, gender identity, marital status, or any other legally protected statu