Cloud Data Engineer — Databricks, Azure & Kafka

Dicetek; Abu Dhabi; On-site; AED 260,000 - 380,000; Full time

Job summary

Dicetek in Abu Dhabi is seeking an accomplished Data Engineer to design, build, and scale cloud data pipelines and warehousing architectures. You will work on ETL/ELT workflows, real-time data processing streams, and scalable storage using Databricks and Azure data technologies.

The ideal candidate brings PySpark, Python, SQL, DeltaLake, and enterprise data modeling expertise, with on-site collaboration with data scientists and analytics teams to support AI/ML workloads.

Qualifications

• Bachelor’s or Master’s degree in Computer Science, Engineering, Data Engineering, or a related technical field.
• Extensive hands-on expertise with Databricks, Azure Data Factory, Azure Data Lake, and DeltaLake.
• Deep proficiency in PySpark, Python, and advanced SQL programming for data transformation.
• Solid practical experience with real-time data processing frameworks such as Apache Kafka.

Responsibilities

• Design, develop, test, and maintain scalable ETL and ELT data pipelines for enterprise data platforms.
• Build robust data integration and transformation solutions utilizing Azure Data Factory, Databricks, and Azure Data Lake.
• Develop advanced data models, data warehouses, and real-time data processing solutions using Kafka and PySpark.
• Implement comprehensive data quality, validation, security governance, and performance optimization practices.
• Support AI/ML and advanced analytics workloads by collaborating directly with Data Scientists and business stakeholders.
• Implement CI/CD and MLOps practices for automated, reliable, and version-controlled data deployments.
• Process, clean, and transform complex datasets using Python, SQL, and DeltaLake architectures.

Skills

Databricks

Azure Data Factory

Delta Lake

PySpark

Python

SQL

Data Modeling

MLOps

ETL/ELT design

Kafka

Cloud data architecture

Education

Bachelor’s or Master’s degree in Computer Science or related field

Tools

Databricks

Azure Data Factory

DeltaLake

Kafka

Job description

Dicetek in Abu Dhabi is seeking an accomplished Data Engineer to design, build, and scale cloud data pipelines and warehousing architectures. You will work on ETL/ELT workflows, real-time data processing streams, and scalable storage using Databricks and Azure data technologies.

The ideal candidate brings PySpark, Python, SQL, DeltaLake, and enterprise data modeling expertise, with on-site collaboration with data scientists and analytics teams to support AI/ML workloads.