Senior Data Engineer (AV)

inDrive; Abu Dhabi; On-site; AED 300,000 - 420,000; Full time

Job summary

inDrive is building the data foundation for autonomous driving and seeks a data engineering lead to own multi-sensor data pipelines. You will manage imagery, GPS tracks, IMU/LiDAR streams, and storage, ensuring synchronization and geo-reference in cloud storage, with cost-aware data lifecycle and validation.

You will collaborate globally, work with BigQuery, PostGIS, and GeoParquet, and mentor teams while improving data quality and performance for ML training datasets across 47 countries.

Qualifications

• 4 years in data engineering
• Experience with multi-sensor data from vehicles or robots (cameras, IMU or LiDAR) and keeping streams in sync
• Experience preparing training datasets for computer vision or autonomous-driving models
• Large volumes of binary or media data in object storage (S3 or GCS) with distributed processing (Spark or equivalent)
• Hands-on experience with spatial data: PostGIS, GeoPandas/Shapely, coordinate reference systems, GPS tracks

Responsibilities

• Build and maintain data pipelines ingesting multi-sensor data from vehicles into cloud storage
• Ensure data streams are synchronized and geo-referenced
• Prepare training datasets for autonomous-driving models and deliver in ML-ready formats
• Collaborate with global teams and optimize data storage costs

Skills

Python

SQL

AWS

GCP

Docker

Kubernetes

BigQuery

PostGIS

GeoParquet

Spark

OpenStreetMap

Tools

Airflow

Databricks

OpenTelemetry

Job description

About the role

We are preparing the data foundation for our autonomous‑driving work and we are hiring the engineer who will start it. Today we collect street‑level imagery and GPS tracks from vehicle cameras, including our own camera units with NVIDIA edge devices on board, and use them to update maps. Next comes a dedicated survey vehicle with a full sensor set multi‑camera IMU LiDAR. You will start with the imagery and map data pipelines we run today and as the sensor platform arrives you will build the pipelines that turn its data into training datasets for autonomous‑driving models. Build the pipelines that move multi‑sensor data multi‑camera video IMU LiDAR GPS from vehicles into cloud storage, synchronize and geo‑reference the streams. Own the storage layout and lifecycle for sensor data partitioning hot and archival tiers cost control as volume grows. Build validation and monitoring on the ingest path incomplete uploads missing or unsynchronized streams vehicles that stopped producing usable data. Prepare training datasets for autonomous‑driving models select data by location route and conditions version datasets and deliver them in the formats ML teams need. Until then take over and develop the current imagery and GPS‑track pipelines from vehicle cameras and contribute to geodata pipelines ingestion from company data OpenStreetMap Overture Maps and vendors conflation validation publication. Work with company data in BigQuery and keep spatial queries fast on large PostGIS and GeoParquet tables. Help us challenge injustice by creating fair choices for millions of people across 47 countries. Develop your professional skills with access to mentoring career consulting and learning programs. Collaborate with teams around the world and gain international experience through our Global Talent Exchange Program. Engage in company‑wide challenges awards sports activities employee‑led social impact and volunteering projects. Work alongside people who take initiative speak openly and challenge themselves to grow. Improve your language skills through co‑financed courses and internal speaking clubs.

• Improve your language skills through co‑financed courses and internal speaking clubs
• Final benefits may vary depending on the location

4years in data engineering Experience with multi‑sensor data from vehicles or robots camerasIMUor LiDAR and keeping the streams in sync Experience preparing training datasets for computer vision or autonomous‑driving models Large volumes of binary or media data in object storage S3 or GCS distributed processing Spark or equivalent Hands‑on experience with spatial data PostGIS GeoPandas Shapely coordinate reference systems GPS tracks Strong Python and SQL AWS or GCP Docker Kubernetes

Nice to have Sensor data formats such as ROS2 bag MCAP or point clouds Parquet Delta or Iceberg Databricks Argo Workflows or Airflow OpenStreetMap and Overture Map QGIS BigQuery

4+ years in data engineering Experience with multi‑sensor data from vehicles or robots: cameras, IMU or LiDAR, and keeping the streams in sync Experience preparing training datasets for computer vision or autonomous‑driving models. Large volumes of binary or media data in object storage (S3 or GCS); distributed processing (Spark or equivalent) Hands‑on experience with spatial data: PostGIS, GeoPandas/Shapely, coordinate reference systems, GPS tracks Strong Python and SQL; AWS or GCP, Docker, Kubernetes Nice to have Sensor data formats such as ROS2 bag, MCAP or point clouds Parquet, Delta or Iceberg; Databricks Argo Workflows or Airflow OpenStreetMap and Overture Map QGIS BigQuery