Azure Data Engineer - Lakehouse Pipelines & DataOps

Sutherland; Abu Dhabi; On-site; AED 250,000 - 420,000; Full time

Job summary

Sutherland in Abu Dhabi is seeking a Data Engineer to design and operate data pipelines from source systems into the lakehouse and onward to analytics and AI consumers.

You will work with Azure Data Factory, Fabric, Databricks or Synapse, implement governance with Purview, and optimize performance, cost, and security in production systems.

This role requires strong English communication and collaboration with architects, data quality engineers and BI teams.

Qualifications

• 4+ years in data engineering in UAE government or regulated sectors.
• Expertise in SQL, Python and PySpark/Spark.
• Experience with Azure Data Factory, Fabric, Databricks or Synapse.
• Knowledge of Purview metadata and lineage.
• English communication strong; Arabic is a plus.

Responsibilities

• Pipeline development: Build batch, incremental, CDC and streaming ingestion pipelines from source systems into the Bronze layer using Azure Data Factory and Fabric pipelines.
• Transformation: Develop Silver- and Gold-layer transformations in SQL, PySpark and Spark notebooks.
• Data modelling: Implement dimensional models, SCDs, surrogate keys and data marts.
• Quality controls: Integrate DQ checks and validation into pipelines.
• Metadata and lineage: Publish metadata and lineage to Microsoft Purview.
• Orchestration: Implement scheduling, dependency management and error handling.

Skills

Advanced SQL

Python

PySpark

Spark

CI/CD practices

English communication

Tools

Azure Data Factory

Microsoft Fabric

Databricks

Synapse

Azure DevOps

GitHub

Purview

Job description

Sutherland in Abu Dhabi is seeking a Data Engineer to design and operate data pipelines from source systems into the lakehouse and onward to analytics and AI consumers.

You will work with Azure Data Factory, Fabric, Databricks or Synapse, implement governance with Purview, and optimize performance, cost, and security in production systems.

This role requires strong English communication and collaboration with architects, data quality engineers and BI teams.