[포티투닷] Senior AI Data Pipeline Engineer (Autonomous Driving) 채용

포티투닷; United States; Presencial; USD 133.000 - 254.000; Jornada completa

Descripción de la vacante

42dot in the United States is seeking an AI Data Pipeline Engineer to build scalable data extraction and labeling pipelines for autonomous driving. You will help develop high-scale data processing systems and a data lakehouse infrastructure, working with ML teams to ensure pipelines align with the overall autonomous driving architecture.

We require 7+ years in data engineering or ML platforms, strong Python SDK skills, and hands-on experience with Databricks or Airflow, Spark, and modern

Formación

• Bachelor's degree or higher in Computer Science, Engineering, Robotics, or a similar technical field.
• Minimum of 7 years of experience in Data Engineering, DataOps or ML Platform roles.
• Proficient in Python and solid experience in Python SDK development.
• Solid experience with data pipeline orchestration (Databricks Workflows or Apache Airflow) and ML model integration.
• Experience with databases (MongoDB, PostgreSQL) and modern data architectures (Hive, Delta Lake).
• Experience with Apache Spark or other big data engines.
• Strong leadership and communication skills.

Responsabilidades

• Develop high-scale, reliable data extraction pipelines from data collection fleets to high-value scene data.
• Develop data labeling pipelines for auto labeling inferences in autonomous driving.
• Build data SDKs for scene data search, dataset preparation, and loading.
• Create data lakehouse for autonomous driving scene datasets (sensor, calibration, annotation).
• Identify performance bottlenecks across data processing pipelines and improve TP coverage.
• Bootstrap and maintain data platform infrastructure (pipeline, database, lakehouse, serving).
• Collaborate with ML, ML apps, and Cloud Infra to align pipelines with the autonomous driving system architecture.

Conocimientos

Leadership

Communication

Problem solving

Educación

Bachelor's degree or higher in Computer Science, Engineering, Robotics, or a similar technical field

Herramientas

Python SDK development

Databricks Workflows

Apache Airflow

MongoDB

PostgreSQL

Hive

Delta Lake

Apache Spark

PyTorch/TensorFlow

Descripción del empleo

We are looking for the bestAbout Us42dot is a mobility AI company committed to solving mobility challenges with software and AI. As the Global Software Center of Hyundai Motor Group, 42dot pioneers the future of mobility by advancing the development of software-defined vehicles.We develop safety-first, user-centric software-defined vehicle technologies that deliver the latest performance through continuous updates like smartphones. By advancing software and AI technology, 42dot envisions a world where everything is connected and moves autonomously through a self-managing urban transportation operating system.Our AI Data Pipeline Engineers build up the core data processing pipelines and datasets readiness for autonomous driving cutting edge algorithms. We develop the distributed system of a scalable data pipeline for large-scale dataset (millions of scenes), as well as high-performance data serving SDKs for ML model training / evaluation. The data pipelines we deliver could highly improve the efficiency of ML model development lifecycle, including training, evaluation, deployment, as well as monitoring in the cloud environment.ResponsibilitiesDevelop high scale, reliable data extraction pipeline to extract millions of raw data from data collection fleet and convert to high-value scene dataDevelop data labeling pipelines to perform the auto labeling inferences for autonomous driving algorithmsDevelop advanced autonomous driving data SDK, including scene data search, datasets preparation, dataset loading, etc.Build up the data lakehouse for autonomous driving scene dataset, including the sensor data, calibration data, as well as annotation dataDig into performance bottlenecks all along the data processing pipelines, from data processing latency, data search latency to Test Procedure (TP) coverage.Bootstrap and maintain infrastructure for data platform components—data processing pipeline, database, data lakehouse and data serving.Collaborate with cross-functional teams, including ML algorithm, ML application, and Cloud Infra to align data pipelines with overall autonomous driving system architecture.

시스템구축(SI) | 모빌리티

• Autonomous Driving
• ML
• AI

We are looking for the best

About Us

42dot is a mobility AI company committed to solving mobility challenges with software and AI. As the Global Software Center of Hyundai Motor Group, 42dot pioneers the future of mobility by advancing the development of software-defined vehicles.

We develop safety-first, user-centric software-defined vehicle technologies that deliver the latest performance through continuous updates like smartphones. By advancing software and AI technology, 42dot envisions a world where everything is connected and moves autonomously through a self-managing urban transportation operating system.

Our AI Data Pipeline Engineers build up the core data processing pipelines and datasets readiness for autonomous driving cutting edge algorithms. We develop the distributed system of a scalable data pipeline for large-scale dataset (millions of scenes), as well as high-performance data serving SDKs for ML model training / evaluation. The data pipelines we deliver could highly improve the efficiency of ML model development lifecycle, including training, evaluation, deployment, as well as monitoring in the cloud environment .

Responsibilities

Develop high scale, reliable data extraction pipeline to extract millions of raw data from data collection fleet and convert to high-value scene data

Develop data labeling pipelines to perform the auto labeling inferences for autonomous driving algorithms

Develop advanced autonomous driving data SDK, including scene data search, datasets preparation, dataset loading, etc.

Build up the data lakehouse for autonomous driving scene dataset, including the sensor data, calibration data, as well as annotation data

Dig into performance bottlenecks all along the data processing pipelines, from data processing latency, data search latency to Test Procedure (TP) coverage.

Bootstrap and maintain infrastructure for data platform components—data processing pipeline, database, data lakehouse and data serving.

Collaborate with cross-functional teams, including ML algorithm, ML application, and Cloud Infra to align data pipelines with overall autonomous driving system architecture .

Qualifications

Bachelor's degree or higher in Computer Science, Engineering, Robotics, or a similar technical field.

Minimum of 7 years of experience in Data Engineering, DataOps or ML Platform roles

Proficient in Python and solid experience in Python SDK development

Solid hands‑on experience with data pipeline job orchestration with Databricks Workflows or Apache Airflow, as well as integrating data pipelines with machine learning models

Solid working experience in Databases (e.g., MongoDB, PostgreSQL, etc)

Extensive experience with data technologies and architectures such as Data Warehouse (e.g., Hive) or Lakehouse (e.g., Delta Lake)

Experience with Apache Spark or other big data computing engines

Excellent leadership and communication skills, with a demonstrated ability to lead technical projects

Preferred Qualifications

Experience with autonomous vehicle sensor data (e.g., LiDAR, camera, radar)

Experience with ML model training lifecycle (e.g., data preparation, model training / validation / deployment, etc)

Understanding of modern AI frameworks (e.g., PyTorch, TensorFlow etc.)

Understanding data governance principles, data privacy regulations, and experience implementing security measures to protect data

Interview Process

Application Review - Coding Test - 1st interview - 2nd interview - Offer Negotiation - Hiring

The screening procedures may vary depending on the position, schedule, or other circumstances.

You will be individually notified of the screening schedule and results via the email address provided in your application.

Compensation

$133,000 - $254,000

Additional Information

In accordance with fair hiring practices, do not include any personal information unrelated to your job qualifications (e.g., Social Security Number, family relations, marital status, age, photo, physical condition, place of birth, etc.) in your resume.

All documents must be submitted in PDF format and under 30MB in size.

We strongly encourage applications from U.S. veterans and candidates eligible for employment preference under applicable laws.

Qualified individuals with disabilities are encouraged to apply and will receive consideration under the Americans with Disabilities Act (ADA).

42dot does not accept unsolicited resumes and will not pay fees for any such submissions. Equal Opportunity Statement

42dot is an Equal Opportunity Employer. We celebrate diversity and are committed to creating an inclusive environment for all employees, regardless of race, color, religion, sex, sexual orientation, gender identity, national origin, age, disability, or veteran status.

Please review the following information before applying.