Azure Data Engineer – Lakehouse Pipelines (6-mo UAE)

Datamatics Technologies LLC

Dubai

In loco

AED 190.000 - 290.000

Tempo pieno

34 ore fa
Candidati tra i primi

Una candidatura completa in un minuto

Curriculum e lettera di presentazione personalizzati, pronti da inviare.

Supera i filtri ATS

Descrizione del lavoro

Datamatics Technologies LLC in the UAE is seeking a Data Engineer to design and operate data pipelines that move data from source systems into the lakehouse and on to analytics and AI consumers. The role focuses on automated, performant, secure pipelines and governance using Azure / Fabric with metadata captured in Microsoft Purview.

You will collaborate across the data architecture, data quality, business analysis and AI engineering teams to deliver production-grade pipelines, maintaining CI/CD

Competenze

  • Advanced SQL, Python and PySpark expertise.
  • Hands-on with Azure Data Factory, Fabric, Databricks or Synapse.
  • Experience with CI/CD and DataOps practices.
  • Knowledge of Microsoft Purview metadata & lineage.

Mansioni

  • Build batch, incremental, CDC and streaming pipelines into Bronze using Azure Data Factory and Fabric.
  • Develop Silver- and Gold-layer transformations in SQL, PySpark; perform cleansing and conformance.
  • Implement dimensional models, SCDs and surrogate keys.
  • Integrate DQ checks and data quality governance with the team.
  • Publish metadata and lineage to Purview; ensure security and access controls.

Conoscenze

Advanced SQL
Python
PySpark
Azure Data Factory
Microsoft Fabric
Databricks
Synapse
SCDs/surrogate keys
DataOps
CI/CD
Purview

Strumenti

Azure DevOps
GitHub

Descrizione del lavoro

Datamatics Technologies LLC in the UAE is seeking a Data Engineer to design and operate data pipelines that move data from source systems into the lakehouse and on to analytics and AI consumers. The role focuses on automated, performant, secure pipelines and governance using Azure / Fabric with metadata captured in Microsoft Purview.

You will collaborate across the data architecture, data quality, business analysis and AI engineering teams to deliver production-grade pipelines, maintaining CI/CD

Ottieni la revisione del curriculum gratis e riservata.

o trascina qui il file.

Similar jobs

Offerte di lavoro simili che vale la pena confrontare

Azure Data Engineer (6-Month) - UAE, Data Lake & Pipelines
Azure Data Engineer (6-Month) - UAE, Data Lake & Pipelines

Datamatics Technologies LLC • Sharjah

In loco
AED 134.000 - 201.000
Azure Data Engineer: Lakehouse & Governance (6 months, UAE)
Azure Data Engineer: Lakehouse & Governance (6 months, UAE)

Datamatics Technologies LLC • Abu Dhabi

In loco
AED 240.000 - 420.000
AWS Data Platform Engineer – Pipelines, Lakehouse & Governance
AWS Data Platform Engineer – Pipelines, Lakehouse & Governance

Dicetek LLC • Abu Dhabi

In loco
AED 280.000 - 420.000
Azure Data Engineer — Build Scalable Data Pipelines
Azure Data Engineer — Build Scalable Data Pipelines

Datamaze.ai • Dubai

In loco
AED 250.000 - 420.000
Data Engineer
Data Engineer

Datamatics Technologies LLC • Sharjah

In loco
AED 134.000 - 201.000
Data Engineer
Data Engineer

Datamatics Technologies LLC • Abu Dhabi

In loco
AED 240.000 - 420.000
Data Engineer
Data Engineer

Datamatics Technologies LLC • Dubai

In loco
AED 190.000 - 290.000
Senior Databricks Lakehouse Engineer - AI/BI Pipelines
Senior Databricks Lakehouse Engineer - AI/BI Pipelines

NR Consulting • Abu Dhabi

In loco
AED 300.000 - 520.000
Data Engineer: Build Scalable Pipelines & Data Lakes
Data Engineer: Build Scalable Pipelines & Data Lakes

Confidential Company • Dubai

In loco
AED 240.000 - 420.000
Azure Data Engineer: Big Data, Spark, Synapse & DevOps
Azure Data Engineer: Big Data, Spark, Synapse & DevOps

IBS Software • Emirati Arabi Uniti

In loco
AED 300.000 - 540.000
Luoghi più richiesti