Azure Data Engineer - Lakehouse Pipelines & Data Governance

Datamatics Technologies

Abu Dhabi

On-site

AED 240,000 - 360,000

Full time

21 hours ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Datamatics Technologies in Abu Dhabi seeks a Data Engineer to design, build and operate data pipelines that move data from source systems into the lakehouse and onward to analytics and AI consumers, ensuring automation, performance, security and governance.

You will work with Azure Data Factory and Fabric pipelines, develop SQL and PySpark transformations, implement dimensional models and SCDs, and ensure metadata and lineage are captured in Microsoft Purview, with CI/CD and robust runbooks.

Qualifications

  • 4+ years in data engineering, preferably in regulated environments in the UAE.
  • Expertise in SQL, Python and PySpark/Spark.
  • Hands-on with Azure Data Factory and modern lakehouse tools (Databricks/Synapse).
  • Strong knowledge of data governance, Purview metadata and lineage.
  • Experience with CI/CD and DataOps practices.
  • Awareness of UAE data regulations (PDPL, Dubai Data Law).

Responsibilities

  • Build batch, incremental, CDC and streaming ingestion pipelines from source systems into the Bronze layer.
  • Develop Silver- and Gold-layer transformations in SQL and PySpark with cleansing and conformance.
  • Implement dimensional models, SCDs and data marts per architectural designs.
  • Integrate data quality checks and reconciliation into pipelines, partnering with QA engineers.
  • Publish metadata and lineage to Microsoft Purview; ensure governance coverage.
  • Ensure CI/CD, deployment automation and test coverage; support handover and runbooks.

Skills

Advanced SQL
Python
PySpark / Spark
Azure Data Factory
Microsoft Fabric
Databricks / Synapse
Lakehouse / Medallion
Dimensional modeling / SCDs
CI/CD / DataOps
Purview metadata & lineage
English communication

Tools

Azure Data Factory
Microsoft Fabric
Databricks
Synapse

Job description

Datamatics Technologies in Abu Dhabi seeks a Data Engineer to design, build and operate data pipelines that move data from source systems into the lakehouse and onward to analytics and AI consumers, ensuring automation, performance, security and governance.

You will work with Azure Data Factory and Fabric pipelines, develop SQL and PySpark transformations, implement dimensional models and SCDs, and ensure metadata and lineage are captured in Microsoft Purview, with CI/CD and robust runbooks.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Azure Data Engineer – Lakehouse Pipelines (6-mo UAE)
Azure Data Engineer – Lakehouse Pipelines (6-mo UAE)

Datamatics Technologies LLC • Dubai

On-site
AED 190,000 - 290,000
Azure Data Engineer: Lakehouse Pipelines & Compliance
Azure Data Engineer: Lakehouse Pipelines & Compliance

Datamatics Technologies • Sharjah

On-site
AED 240,000 - 360,000
Data Engineer: Azure Lakehouse Pipelines & Governance UAE
Data Engineer: Azure Lakehouse Pipelines & Governance UAE

Datamatics Global Services Ltd • Dubai

On-site
AED 240,000 - 360,000
Azure Data Engineer (6-Month) - UAE, Data Lake & Pipelines
Azure Data Engineer (6-Month) - UAE, Data Lake & Pipelines

Datamatics Technologies LLC • Sharjah

On-site
AED 134,000 - 201,000
Azure Data Engineer: Lakehouse & Governance (6 months, UAE)
Azure Data Engineer: Lakehouse & Governance (6 months, UAE)

Datamatics Technologies LLC • Abu Dhabi

On-site
AED 240,000 - 420,000
AWS Data Platform Engineer – Pipelines, Lakehouse & Governance
AWS Data Platform Engineer – Pipelines, Lakehouse & Governance

Dicetek LLC • Abu Dhabi

On-site
AED 280,000 - 420,000
Data Engineer - Azure Fabric & Lakehouse (UAE, 6m)
Data Engineer - Azure Fabric & Lakehouse (UAE, 6m)

Datamatics Global Services Ltd • Sharjah

On-site
AED 180,000 - 360,000
Data Engineer - Build Scalable Lakehouse Pipelines (UAE)
Data Engineer - Build Scalable Lakehouse Pipelines (UAE)

Datamatics Global Services Ltd • Abu Dhabi

On-site
AED 201,000 - 357,000
Azure Data Engineer — Build Scalable Data Pipelines
Azure Data Engineer — Build Scalable Data Pipelines

Datamaze.ai • Dubai

On-site
AED 250,000 - 420,000
Senior Databricks Lakehouse Engineer - AI/BI Pipelines
Senior Databricks Lakehouse Engineer - AI/BI Pipelines

NR Consulting • Abu Dhabi

On-site
AED 300,000 - 520,000
Top locations