Data Engineer, Azure & Databricks + Airflow Expert

Tech Junction Ltd; Dubai; On-site; AED 240,000 - 420,000; Full time

Job summary

IT Excellence in Dubai, UAE is seeking an experienced Data Engineer to own end-to-end data pipelines and cloud data lake modeling. You will work with data scientists, LLM engineers, and product analysts to deliver scalable, high‑performing data systems using Azure technologies and Spark-based processing.

The role requires 3–5+ years in data engineering, strong Azure expertise, and immediate availability for deployment in Dubai. Competitive market salary and onsite work setup apply.

Qualifications

• Bachelor's or Master's degree in Computer Science, Software Engineering, Information Technology, or related technical discipline.
• Minimum 3–5+ years of hands-on Data Engineering in enterprise cloud environments.
• Strong SQL and professional Python/Scala programming.

Responsibilities

• Design, develop, and maintain robust ETL/ELT pipelines using Azure Data Factory, Azure Databricks, PySpark, Scala, and SQL.
• Build and optimize data models and analytical tables using Azure Synapse Analytics and Azure Data Lake Storage Gen2.
• Deploy Apache Airflow pipelines on Red Hat Linux using Kubernetes and implement data quality checks, validation, and monitoring.
• Collaborate with Data Scientists and Product Analysts to deliver clean, accessible enterprise data.
• Automate infrastructure workflows with CI/CD pipelines and IaC tools (ARM, Bicep, Terraform).

Skills

SQL proficiency

Python/Scala

Azure Data Factory

Azure Databricks

Azure Synapse Analytics

Data modeling

Airflow

Kubernetes

Linux

Education

Bachelor's or Master's in CS/Engineering

Tools

Azure Data Factory

Azure Databricks

Azure Synapse Analytics

Azure Data Lake Storage Gen2

Azure Blob Storage

Apache Spark / PySpark

Airflow

Kubernetes

Job description

IT Excellence in Dubai, UAE is seeking an experienced Data Engineer to own end-to-end data pipelines and cloud data lake modeling. You will work with data scientists, LLM engineers, and product analysts to deliver scalable, high‑performing data systems using Azure technologies and Spark-based processing.

The role requires 3–5+ years in data engineering, strong Azure expertise, and immediate availability for deployment in Dubai. Competitive market salary and onsite work setup apply.