Senior Data Engineer - Azure Databricks & PySpark

Duncan & Ross; Abu Dhabi; On-site; AED 260,000 - 380,000; Full time

Job summary

Duncan & Ross is hiring a Data Engineer for a leading client in Dubai. You’ll design, build and run scalable data pipelines and data warehouse solutions on Azure and Databricks, turning raw data from across the business into trusted, analytics-ready data.

You will work with data analysts, data scientists and business stakeholders, ensuring data quality and governance, while optimizing Spark jobs for performance and cost.

Qualifications

• 3–5+ years of hands-on data engineering experience.

Responsibilities

• Design, build and maintain ETL/ELT pipelines that ingest, transform and load data from multiple source systems into Azure and Databricks.

Skills

Data pipelines

SQL

PySpark

Python

Azure

Databricks

Delta Lake

Data governance

CI/CD

Git

ETL/ELT

Airflow

Education

Bachelor's degree in Computer Science or related field

Tools

Azure Data Factory

Databricks

Azure Synapse

Unity Catalog

Purview

Job description

Duncan & Ross is hiring a Data Engineer for a leading client in Dubai. You’ll design, build and run scalable data pipelines and data warehouse solutions on Azure and Databricks, turning raw data from across the business into trusted, analytics-ready data.

You will work with data analysts, data scientists and business stakeholders, ensuring data quality and governance, while optimizing Spark jobs for performance and cost.