Senior AI Data Pipeline Architect - Autonomous Driving

42dot; Sunnyvale (CA); On-site; USD 133,000 - 254,000; Full time

Job summary

42dot in Sunnyvale, California is seeking a Data Pipeline Engineer to develop high-scale data extraction pipelines and manage data labeling for autonomous driving algorithms. The ideal candidate will have at least 7 years of experience in Data Engineering and strong proficiency in Python. The role offers competitive compensation ranging from $133,000 to $254,000, and comes with a commitment to diversity and inclusive work environment.

Qualifications

• 7+ years of experience in Data Engineering, DataOps or ML Platform roles.
• Solid hands-on experience with data pipeline job orchestration.
• Experience with databases and data technologies.

Responsibilities

• Develop high scale, reliable data extraction pipeline.
• Develop data labeling pipelines for autonomous driving algorithms.
• Build up the data lakehouse for autonomous driving scene dataset.

Skills

Python

Data pipeline orchestration

Communication skills

Data technologies and architectures

Leadership

Education

Bachelor's degree or higher in Computer Science, Engineering, Robotics, or a similar technical field

Tools

Databricks Workflows

Apache Airflow

MongoDB

PostgreSQL

Apache Spark

Job description

42dot in Sunnyvale, California is seeking a Data Pipeline Engineer to develop high-scale data extraction pipelines and manage data labeling for autonomous driving algorithms. The ideal candidate will have at least 7 years of experience in Data Engineering and strong proficiency in Python. The role offers competitive compensation ranging from $133,000 to $254,000, and comes with a commitment to diversity and inclusive work environment.