Data Engineer - Python

edari; Dubai; On-site; AED 180,000 - 320,000; Full time

Job summary

edari seeks a Data Engineer in Dubai to design, build and maintain scalable data pipelines and data solutions for a major client. The role emphasizes ETL/ELT pipelines, data modelling, MDM and large-scale data processing using SQL, Python and Apache Spark.

This 12-month contract is renewable and sits within the Data & AI team, reporting to the Associate Director of Data Engineering. Availability is immediate or within 30 days.

Qualifications

• 5 years of proven experience in data engineering.
• Strong background in ETL/ELT pipelines in enterprise environments.
• Experience with data modelling including dimensional and canonical models.
• Hands-on MDM, data quality and governance practices.
• Strong SQL, Python and Spark skills.

Responsibilities

• Design, build and support ETL/ELT data pipelines in enterprise environments.
• Develop and maintain data models and data products.
• Implement MDM practices including gold records and data quality management.
• Build scalable data solutions using SQL, Python and Spark for large-scale processing.
• Establish data quality controls and validation frameworks.
• Translate business requirements into scalable data solutions with stakeholders.
• Support governance, metadata management and enterprise data foundations.

Skills

ETL/ELT pipelines

Data modelling

MDM

SQL

Python

Apache Spark

Palantir Foundry

Tools

Palantir Foundry

Job description

We are looking for a Data Engineer to design, build and maintain scalable data pipelines and data solutions for our client, a massive semi-government entity in Dubai. This role requires strong experience in ETL/ELT pipelines, data modelling, Master Data Management (MDM) and large-scale data processing using SQL, Python and Apache Spark.

This role will begin on a 12-month contract bases and is renewable. It sits within the Data & AI team and reports into the Associate Director of Data Engineering.

Key Responsibilities:

• Design, build and support ETL/ELT data pipelines within enterprise environments.
• Develop and maintain data models, including dimensional models, canonical data models and data products.
• Implement Master Data Management (MDM) practices, including golden record concepts, data standardisation and data quality management.
• Build scalable and maintainable data solutions using SQL, Python and Apache Spark to support large-scale data processing.
• Establish data quality controls, validation frameworks and performance optimisation practices to ensure efficient and reliable data processing.
• Translate business requirements into scalable data solutions, working closely with business stakeholders and technical teams.
• Support data governance, metadata management and the development of enterprise data foundations.
• Communicate technical concepts clearly to both technical and non-technical stakeholders.
• 5 years of proven experience in data engineering, with a strong background in designing, building and supporting ETL/ELT data pipelines in enterprise environments.
• Strong understanding of data modelling, including dimensional modelling, canonical data models and data product design.
• Hands-on experience with Master Data Management (MDM), golden records, data standardisation and data quality management.
• Strong SQL skills and practical experience with Python and Apache Spark.
• Good understanding of data engineering best practices, including scalability, maintainability, data quality, validation and performance optimisation.
• Experience translating business requirements into technical solutions and working with stakeholders across business and technology teams.
• Experience with modern data platforms and cloud-based data ecosystems.
• Familiarity with data governance, metadata management and enterprise data foundations.
• Experience with Palantir Foundry would be highly desirable.

Availability: Preference will be given to candidates available immediately or within a maximum of 30 days.

We are looking for a candidate who will be able to work in the United Arab Emirates.