Data Engineer: Azure Lakehouse Pipelines & Governance UAE

Datamatics Global Services Ltd

Dubai

On-site

AED 240,000 - 360,000

Full time

2 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Datamatics Global Services Ltd in the UAE is seeking a Data Engineer to build and operate data pipelines moving data from source systems into the lakehouse, enabling analytics and AI consumers while ensuring automation, performance, security and governance. You will work with Azure Fabric and Purview to capture metadata and lineage for compliant data delivery.

The role collaborates with data architects, data quality engineers and analysts to deliver production-grade pipelines, leveraging

Qualifications

  • 4+ years in data engineering, UAE government or regulated sectors.
  • Advanced SQL, Python and PySpark/Spark skills.
  • Hands-on with Azure Data Factory, Microsoft Fabric, Databricks or Synapse.
  • Strong dimensional modelling and SCDs.
  • CI/CD and DataOps familiarity.
  • Familiarity with Microsoft Purview metadata and lineage.
  • Excellent English communication and documentation.

Responsibilities

  • Build batch, incremental, CDC and streaming ingestion pipelines into Bronze layer using ADF and Fabric.
  • Develop Silver- and Gold-layer transformations in SQL, PySpark and Spark notebooks.
  • Implement dimensional models, SCDs and surrogate keys.
  • Integrate DQ checks and validation with Senior Data Quality Engineer.
  • Publish metadata and lineage to Microsoft Purview.
  • Ensure scheduling, dependencies, parameterization, error handling and alerts.
  • Optimize pipelines for performance and cost using Delta/Parquet formats.
  • Apply access controls, masking and encryption per UAE PDPL and related laws.
  • Maintain code in source control and deploy via CI/CD with tests.
  • Support production operations and handover runbooks.
  • Coach counterparts so pipelines can be sustained after handover.

Skills

Advanced SQL
Python
PySpark
Data modeling
CI/CD practices
English communication

Tools

Azure Data Factory
Microsoft Fabric
Databricks
Synapse
GitHub
Azure DevOps

Job description

Datamatics Global Services Ltd in the UAE is seeking a Data Engineer to build and operate data pipelines moving data from source systems into the lakehouse, enabling analytics and AI consumers while ensuring automation, performance, security and governance. You will work with Azure Fabric and Purview to capture metadata and lineage for compliant data delivery.

The role collaborates with data architects, data quality engineers and analysts to deliver production-grade pipelines, leveraging

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Azure Data Engineer – Lakehouse Pipelines (6-mo UAE)
Azure Data Engineer – Lakehouse Pipelines (6-mo UAE)

Datamatics Technologies LLC • Dubai

On-site
AED 190,000 - 290,000
Data Engineer - Build Scalable Lakehouse Pipelines (UAE)
Data Engineer - Build Scalable Lakehouse Pipelines (UAE)

Datamatics Global Services Ltd • Abu Dhabi

On-site
AED 201,000 - 357,000
Azure Data Engineer (6-Month) - UAE, Data Lake & Pipelines
Azure Data Engineer (6-Month) - UAE, Data Lake & Pipelines

Datamatics Technologies LLC • Sharjah

On-site
AED 134,000 - 201,000
Azure Data Engineer: Lakehouse & Governance (6 months, UAE)
Azure Data Engineer: Lakehouse & Governance (6 months, UAE)

Datamatics Technologies LLC • Abu Dhabi

On-site
AED 240,000 - 420,000
AWS Data Platform Engineer – Pipelines, Lakehouse & Governance
AWS Data Platform Engineer – Pipelines, Lakehouse & Governance

Dicetek LLC • Abu Dhabi

On-site
AED 280,000 - 420,000
Data Engineer: Build Scalable Pipelines & Data Lakes
Data Engineer: Build Scalable Pipelines & Data Lakes

Confidential Company • Dubai

On-site
AED 240,000 - 420,000
Data Engineer
Data Engineer

Datamatics Global Services Ltd • Abu Dhabi

On-site
AED 201,000 - 357,000
Data Engineer
Data Engineer

Datamatics Global Services Ltd • Dubai

On-site
AED 240,000 - 360,000
Data Engineer
Data Engineer

Datamatics Technologies LLC • Abu Dhabi

On-site
AED 240,000 - 420,000
Data Engineer
Data Engineer

Datamatics Technologies LLC • Dubai

On-site
AED 190,000 - 290,000
Top locations