Azure Data Engineer: Lakehouse Pipelines & Compliance

Datamatics Technologies

Sharjah

On-site

AED 240,000 - 360,000

Full time

7 hours ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Datamatics Technologies in the United Arab Emirates is seeking a Data Engineer to design, build and operate data pipelines that move data from source systems into the lakehouse and onward to analytics and AI consumers.

You will work with Azure Data Factory and Fabric, Databricks or Synapse, implementing security, governance and CI/CD practices to deliver production-grade solutions. The role requires 4+ years in data engineering and excellent English communication.

Qualifications

  • 4+ years in data engineering, UAE government or regulated environments.
  • Advanced SQL, Python and PySpark/Spark skills.
  • Hands-on experience with Azure Data Factory, Fabric, Databricks or Synapse.
  • Strong understanding of Lakehouse/Medallion architecture, Delta/Parquet formats and dimensional modelling, including SCDs and surrogate keys.
  • Experience with CI/CD (Azure DevOps or GitHub), source control and DataOps practices.
  • Familiarity with Microsoft Purview metadata and lineage, and with DQ tooling.
  • Awareness of UAE data regulation, including UAE PDPL, the Dubai Data Law and DESC ISR.
  • Excellent English communication and documentation skills.

Responsibilities

  • Build batch, incremental, CDC and streaming ingestion pipelines from sources into Bronze layer.
  • Develop Silver- and Gold-layer transformations in SQL, PySpark and Spark notebooks.
  • Implement dimensional models, SCDs, surrogate keys and data marts according to the architect's designs.
  • Integrate DQ checks, validation, quarantine and reconciliation into pipelines with the Senior Data Quality Engineer.
  • Ensure that pipelines publish metadata and lineage to Microsoft Purview.
  • Implement scheduling, dependency management, parameterization, error handling and alerting.
  • Optimize pipelines, partitioning, file formats (Delta/Parquet) and compute usage for performance and cost efficiency.
  • Apply access controls, masking, encryption and secure credential management in line with UAE PDPL, Dubai Data Law and DESC ISR.
  • Maintain code in source control and deploy through CI/CD pipelines, with automated tests and environment promotion.
  • Support production operations, incident resolution and runbooks, and coach counterparts for handover.

Skills

Advanced SQL
Python
PySpark / Spark
Azure Data Factory
Microsoft Fabric
Databricks
Synapse
CI/CD
DataOps
English communication

Tools

Azure Data Factory
Microsoft Fabric
Databricks
Synapse
Microsoft Purview

Job description

Datamatics Technologies in the United Arab Emirates is seeking a Data Engineer to design, build and operate data pipelines that move data from source systems into the lakehouse and onward to analytics and AI consumers.

You will work with Azure Data Factory and Fabric, Databricks or Synapse, implementing security, governance and CI/CD practices to deliver production-grade solutions. The role requires 4+ years in data engineering and excellent English communication.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Azure Data Engineer – Lakehouse Pipelines (6-mo UAE)
Azure Data Engineer – Lakehouse Pipelines (6-mo UAE)

Datamatics Technologies LLC • Dubai

On-site
AED 190,000 - 290,000
Azure Data Engineer (6-Month) - UAE, Data Lake & Pipelines
Azure Data Engineer (6-Month) - UAE, Data Lake & Pipelines

Datamatics Technologies LLC • Sharjah

On-site
AED 134,000 - 201,000
Data Engineer: Azure Lakehouse Pipelines & Governance UAE
Data Engineer: Azure Lakehouse Pipelines & Governance UAE

Datamatics Global Services Ltd • Dubai

On-site
AED 240,000 - 360,000
Data Engineer - Build Scalable Lakehouse Pipelines (UAE)
Data Engineer - Build Scalable Lakehouse Pipelines (UAE)

Datamatics Global Services Ltd • Abu Dhabi

On-site
AED 201,000 - 357,000
Azure Data Engineer: Lakehouse & Governance (6 months, UAE)
Azure Data Engineer: Lakehouse & Governance (6 months, UAE)

Datamatics Technologies LLC • Abu Dhabi

On-site
AED 240,000 - 420,000
AWS Data Platform Engineer – Pipelines, Lakehouse & Governance
AWS Data Platform Engineer – Pipelines, Lakehouse & Governance

Dicetek LLC • Abu Dhabi

On-site
AED 280,000 - 420,000
Azure Data Engineer — Build Scalable Data Pipelines
Azure Data Engineer — Build Scalable Data Pipelines

Datamaze.ai • Dubai

On-site
AED 250,000 - 420,000
Senior Databricks Lakehouse Engineer - AI/BI Pipelines
Senior Databricks Lakehouse Engineer - AI/BI Pipelines

NR Consulting • Abu Dhabi

On-site
AED 300,000 - 520,000
Data Engineer
Data Engineer

Datamatics Technologies • Sharjah

On-site
AED 240,000 - 360,000
Data Engineer
Data Engineer

Datamatics Global Services Ltd • Abu Dhabi

On-site
AED 201,000 - 357,000
Top locations