Data Engineer: Build Scalable Pipelines & AI-Ready Data

Client of Alpha Data Recruitment; Abu Dhabi; On-site; AED 300,000 - 540,000; Full time

Job summary

Client of Alpha Data Recruitment is seeking a Data Engineer to design, build, and maintain scalable data platforms and pipelines in Abu Dhabi. The role focuses on delivering reliable, analytics-ready data solutions and supporting AI-ready datasets.

Responsibilities include designing large-scale ingestion and processing systems, building batch and real-time pipelines, and ensuring data quality, governance, and observability across data platforms.

Qualifications

• Experience with modern data platforms and big data tools.
• Strong knowledge of data modeling, ETL/ELT, and data governance.
• Proficiency in Python/Scala/Java and SQL with hands-on coding experience.
• Experience with batch and streaming data pipelines.
• Experience with data quality, observability, and data cataloging.

Responsibilities

• Design and develop large-scale data ingestion, storage, and processing solutions.
• Build and maintain batch and real-time data pipelines.
• Develop scalable data platforms handling structured and unstructured data.
• Implement data models, CDC, and data integration solutions.
• Ensure data quality, governance, observability, and operational excellence.

Skills

Data Engineering

ETL/ELT

Data Modeling

OLAP

CDC

Python

Scala

Java

SQL

Apache NiFi

Kafka

Spark

Flink

Airflow

Tools

MinIO/S3

Kafka

Avro

Parquet

ORC

Job description

Client of Alpha Data Recruitment is seeking a Data Engineer to design, build, and maintain scalable data platforms and pipelines in Abu Dhabi. The role focuses on delivering reliable, analytics-ready data solutions and supporting AI-ready datasets.

Responsibilities include designing large-scale ingestion and processing systems, building batch and real-time pipelines, and ensuring data quality, governance, and observability across data platforms.