Data Engineer

Datamatics Technologies LLC

Abu Dhabi

On-site

AED 240,000 - 420,000

Part time

34 hours ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Datamatics Technologies LLC in UAE is seeking a Data Engineer for a 6-month assignment. You will build and operate data pipelines moving data from source systems into the lakehouse and analytics layer, ensuring automated, secure, and governed flows on Azure and Fabric.

Key tasks include developing batch/incremental/CDC/streaming ingestions, transformations in PySpark, and implementing SCDs with data marts. Strong English communication is essential.

Qualifications

  • 4+ years in data engineering, preferably in regulated environments.
  • Advanced SQL, Python and PySpark/Spark.
  • Hands-on with Azure Data Factory, Microsoft Fabric, Databricks or Synapse.
  • Strong knowledge of Lakehouse/Medallion architecture and Delta/Parquet formats.
  • Experience with CI/CD (Azure DevOps or GitHub) and DataOps.
  • Familiarity with Purview metadata/lineage and DQ tooling.
  • Awareness of UAE data regulations (PDPL, Dubai Data Law).
  • Excellent English communication and documentation.

Responsibilities

  • Build batch, incremental, CDC and streaming ingestion pipelines from sources into Bronze layer using Azure Data Factory and Fabric pipelines.
  • Develop Silver- and Gold-layer transformations in SQL, PySpark and Spark notebooks.
  • Implement dimensional models, SCDs and data marts as designed.
  • Integrate data quality checks, validation, quarantine and reconciliation with Data Quality Engineer.
  • Ensure pipelines publish metadata and lineage to Purview.
  • Implement scheduling, dependency management and error handling.

Skills

Advanced SQL
Python
PySpark
Azure Data Factory
Microsoft Fabric
Databricks
Synapse
Data Lakehouse
DataOps
CI/CD

Tools

Azure Data Factory
Databricks
Synapse
Microsoft Fabric
Purview
GitHub

Job description

Location: UAE-based (Travel required)

Duration: 6-month assignment

Summary (Data Engineer)

Timely, reliable data pipelines are what turn a platform design into business value. The Data Engineer builds and operates the pipelines that move data from source systems into the lakehouse and on to analytics and AI consumers, ensuring that the pipelines are automated, performant, secure and governed. The role works alongside the data architect, data quality engineer, business analysts and AI engineers, delivering production-grade pipelines on Azure / Microsoft Fabric, with metadata and lineage captured in Microsoft Purview.

Responsibilities
  • Build batch, incremental, CDC and streaming ingestion pipelines from source systems into the Bronze layer, using Azure Data Factory and Fabric pipelines.
  • Develop Silver- and Gold-layer transformations in SQL, PySpark and Spark notebooks, including cleansing, conformance, enrichment and business-rule logic.
  • Implement dimensional models, SCDs, surrogate keys and data marts according to the architect's designs.
  • Integrate DQ checks, validation, quarantine and reconciliation into pipelines in partnership with the Senior Data Quality Engineer.
  • Ensure that pipelines publish metadata and lineage to Microsoft Purview.
  • Implement scheduling, dependency management, parameterization, error handling and alerting.
  • Optimize pipelines, partitioning, file formats (Delta/Parquet) and compute usage for performance and cost efficiency.
  • Apply access controls, masking, encryption and secure credential management in line with UAE PDPL, the Dubai Data Law and DESC ISR.
  • Maintain code in source control and deploy through CI/CD pipelines, with automated tests and environment promotion.
  • Support production operations, incident resolution and runbooks, and coach counterparts so that the pipelines can be sustained after handover.
Must Have
  • 4+ years in data engineering, preferably within UAE government or regulated-sector environments.
  • Advanced SQL, Python and PySpark/Spark skills.
  • Hands-on experience with Azure Data Factory, Microsoft Fabric, Databricks or Synapse.
  • Strong understanding of Lakehouse/Medallion architecture, Delta/Parquet formats and dimensional modelling, including SCDs and surrogate keys.
  • Experience with CI/CD (Azure DevOps or GitHub), source control and DataOps practices.
  • Familiarity with Microsoft Purview metadata and lineage, and with DQ tooling.
  • Awareness of UAE data regulation, including UAE PDPL, the Dubai Data Law and DESC ISR.
  • Excellent English communication and documentation skills.
Good to Have
  • Arabic proficiency is an advantage.
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Data Engineer
Data Engineer

Datamatics Technologies LLC • Dubai

On-site
AED 190,000 - 290,000
Data Engineer
Data Engineer

Datamatics Technologies LLC • Sharjah

On-site
AED 134,000 - 201,000
Data Quality Engineer
Data Quality Engineer

Datamatics Technologies LLC • Abu Dhabi

On-site
AED 167,000 - 312,000
Data Engineer - Python
Data Engineer - Python

edari • Dubai

On-site
AED 180,000 - 320,000
AI Data Engineer
AI Data Engineer

Tawasol Solution and Services LLC • Dubai

On-site
AED 335,000 - 469,000
Azure Data Engineer (6-Month) - UAE, Data Lake & Pipelines
Azure Data Engineer (6-Month) - UAE, Data Lake & Pipelines

Datamatics Technologies LLC • Sharjah

On-site
AED 134,000 - 201,000
Senior Data Engineer
Senior Data Engineer

Akkodis • Dubai

On-site
AED 350,000 - 600,000
DATA ENGINEER - AZURE DATABRICKS & PYSPARK
DATA ENGINEER - AZURE DATABRICKS & PYSPARK

Duncan & Ross Consulting • Dubai

On-site
AED 250,000 - 380,000
Senior Data Engineer
Senior Data Engineer

NorthBay Solutions LLC • Abu Dhabi

On-site
AED 240,000 - 480,000
Data Engineer | IT Excellence | Dubai, UAE
Data Engineer | IT Excellence | Dubai, UAE

Tech Junction Ltd • Dubai

On-site
AED 240,000 - 420,000
Top locations