Data Engineer

Client of Alpha Data Recruitment; Abu Dhabi; On-site; AED 300,000 - 540,000; Full time

Job summary

Client of Alpha Data Recruitment is seeking a Data Engineer to design, build, and maintain scalable data platforms and pipelines in Abu Dhabi. The role focuses on delivering reliable, analytics-ready data solutions and supporting AI-ready datasets.

Responsibilities include designing large-scale ingestion and processing systems, building batch and real-time pipelines, and ensuring data quality, governance, and observability across data platforms.

Qualifications

• Experience with modern data platforms and big data tools.
• Strong knowledge of data modeling, ETL/ELT, and data governance.
• Proficiency in Python/Scala/Java and SQL with hands-on coding experience.
• Experience with batch and streaming data pipelines.
• Experience with data quality, observability, and data cataloging.

Responsibilities

• Design and develop large-scale data ingestion, storage, and processing solutions.
• Build and maintain batch and real-time data pipelines.
• Develop scalable data platforms handling structured and unstructured data.
• Implement data models, CDC, and data integration solutions.
• Ensure data quality, governance, observability, and operational excellence.

Skills

Data Engineering

ETL/ELT

Data Modeling

OLAP

CDC

Python

Scala

Java

SQL

Apache NiFi

Kafka

Spark

Flink

Airflow

Tools

MinIO/S3

Kafka

Avro

Parquet

ORC

Job description

The Data Engineer will design, build, and maintain scalable data platforms and pipelines. The role involves working with modern big data technologies to deliver reliable, high-quality data solutions. The candidate will collaborate with various teams to support analytics, reporting, and AI-ready datasets.

Responsibilities

• Design and develop large-scale data ingestion, storage, and processing solutions.
• Build and maintain batch and real-time data pipelines.
• Develop scalable and high-performance data platforms handling structured and unstructured data.
• Implement data models, change data capture (CDC), and data integration solutions.
• Ensure data quality, governance, observability, and operational excellence.

Qualifications

• Experience with Apache NiFi, Kafka, Spark, Flink, and Airflow
• Strong knowledge of Data Engineering, ETL/ELT, Data Modeling, OLAP, and CDC
• Proficiency in Python, Scala, or Java
• Advanced SQL skills
• Experience with MinIO/S3, Kafka, Avro, Parquet, and ORC

Desired Candidate Profile