Machine Learning Engineer: Evaluation

Bedrock Robotics; New York (NY); On-site; USD 100,000 - 150,000; Full time

Job summary

Bedrock Robotics in New York is seeking Senior or Staff level engineers to join their team. The focus is on developing advanced autonomy for heavy construction machinery. You will design and maintain systems for performance evaluation, develop metrics for decision-making, and classify data sources for further analysis. Candidates should have over 5 years of experience in software engineering or data science and proficiency in Python. This role promises the opportunity to significantly impact project timelines and safety in construction.

Qualifications

• Must have 5+ years of software engineering, data science, or research experience.
• Experience with statistical methods in ML and robotics is a plus.

Responsibilities

• Design and maintain evaluation systems for performance measurement.
• Develop metrics to connect product goals with system behavior.
• Classify data sources for training and testing using infrastructure and classifiers.
• Predict system performance through modeling metrics and interpreting results.

Skills

Senior or Staff level engineers

5+ years of software engineering experience

2+ years in ML or robotics analysis

Proficiency in Python

Statistical analysis skills

Experience with large datasets

Job description

Overview

Join the team bringing advanced autonomy to the built world. Bedrock is applying autonomous systems to heavy construction machinery to accelerate project timelines and improve safety on job sites. We’re a group of veterans from the autonomous vehicle industry focused on delivering automation to the construction sector.

What You’ll Do

• Design and maintain evaluation systems: build pipelines for measuring system performance across open-loop and closed-loop simulation, hardware-in-the-loop systems, and field data from Bedrock Operator equipped machinery. Enable insights earlier in development by creating streamlined workflows that excite other teams.
• Develop metrics: connect product goals and system behavior by turning real-world specifications into measurable indicators from logged data; enable confident decision-making through objective insights from parameter tuning to program planning.
• Classify data sources for training and testing: implement infrastructure and classifiers to self-annotate data and create datasets for diverse training and evaluation use cases; leverage models to source rich annotations for large datasets to accelerate iteration.
• Predict system performance: model metrics and interpret results from raw sensor data and leading indicators; assess whether new construction sites pose hidden challenges and drive deployment readiness decisions.

What We’re Looking For

• Senior or Staff level engineers with 5+ years of professional software engineering, data science, or research experience
• 2+ years of experience analyzing modern ML or robotics system performance on real-world problems
• Proficiency in Python and a data warehouse query language; comfort with development on infrastructure within parallelized cloud-based frameworks
• Strong statistical analysis skills (e.g., classification, model fit bias determination, hypothesis testing, uncertainty quantification)
• Experience working with large datasets
• Bonus points: experience applying statistical methods to ML research or real-world robotics applications