Senior Software Engineer, ML Evaluation

Motional; Boston (MA); On-site; USD 159,000 - 207,000; Full time

Benefits offered by this job

Medical, dental, vision benefits

401k with company match

Health savings accounts

Life and pet insurance

Job summary

Motional is seeking a highly skilled Senior Data Analysis Engineer in Boston, Massachusetts, to work on large-scale AI model evaluation for autonomous vehicles. This role involves collaborating with ML engineers and developing metrics for vehicle performance validation.

The ideal candidate has a strong background in data science and machine learning, with experience in Python and distributed data processing technologies. Competitive compensation between $159,000 - $207,000 USD is offered, along with comprehensive benefits.

Qualifications

• Strong programming skills in Python and related data analysis frameworks.
• Experience in machine learning, data mining, and statistical analysis.
• Experience with large-scale data processing and distributed computing technologies.

Responsibilities

• Develop new data analysis metrics and KPIs for validation of autonomous vehicle performance.
• Research and develop new large-scale data analysis systems.
• Own large-scale data analysis workflows.
• Build high-quality datasets to improve ML products.
• Provide statistical depth on model performance through rigorous error analysis.

Skills

Python

Data Analysis

Machine Learning

Statistical Analysis

Education

Bachelor's or Master's degree in Computer Science, Data Science, or a related field

Tools

SciPy

Job description

Mission

We are seeking a highly skilled and motivated Senior Data Analysis Engineer for our large-scale AI model and software evaluation framework – Ground Truth Regression. The ideal candidate will have a strong background in data engineering, machine learning principals and statistical analysis.

At Motional, large scale orchestration for data analysis plays a critical role in delivering our ML-centered autonomous driving vehicle. Our robo-taxi ML Models and software are developed by hundreds of developers and deployed multiple times a day - The Ground Truth Regression team provides the large scale perception analysis framework for validating all changes to perception which can impact the autonomous vehicle behavior.

The GTRegression team validates the end impact of ML and software changes to the autonomous vehicle while those changes are in development, providing the tools for Root Cause Analysis, and safety consideration. We monitor for model errors, anomalies, rare objects & long-tail driving scenarios across thousands of driving hours. The team develops the full stack - AWS Kubernetes orchestration framework, ReSimulation, model metrics, regression reports, and deep dive analysis UI’s. The team works together with all other perception and ML teams to develop the metrics and analyze results.

Responsibilities

• Work with ML Engineers and Autonomy Software Developers to develop new data analysis metrics and KPI’s for the validation of the autonomous vehicle performance.
• Drive innovation by researching and developing new large scale data analysis systems.
• Own large-scale data analysis workflows that surface unexpected impacts of planned and unplanned changes to the ML models and software.
• Build high-quality datasets to improve ML products through training & edge case validation.
• Provide statistical depth on model performance & generalization through rigorous error and change analysis.

Qualifications

• Bachelor's or Master's degree in Computer Science, Data Science, or a related field.
• Strong programming skills in Python, SciPy, and related data analysis frameworks.
• Experience in machine learning, data mining, and statistical analysis.
• Experience with large-scale data processing and distributed computing technologies.
• Strong communication and software development skills: goal setting, design documentation, test frameworks, collaborative cross team development.

Bonus Points

• Ph.D. in Computer Science or a related field.
• Experience with cloud platforms such as AWS, Google Cloud, or Azure.
• Experience with machine learning in the autonomous driving domain.
• Publications or contributions to the AI/ML community.

Benefits

Candidates for certain positions are eligible to participate in Motional’s benefits program. Motional’s benefits include but are not limited to medical, dental, vision, 401k with a company match, health saving accounts, life insurance, pet insurance, and more.

Compensation

Salary Range: $159,000 - $207,000 USD

Motional AD Inc. is an EOE. We celebrate diversity and are committed to creating an inclusive environment for all employees. To comply with Federal Law, we participate in E-Verify. All newly-hired employees are queried through this electronic system established by the DHS and the SSA to verify their identity and employment eligibility.