Data Engineer - Build Scalable AI Data Pipelines

DISCOVERED; Abu Dhabi; On-site; AED 240,000 - 420,000; Full time

Job summary

DISCOVERED partners with a leading financial services organisation in Abu Dhabi to advance its Data & AI capabilities. We seek an experienced Data Engineer to build scalable data infrastructure and pipelines powering AI/ML across the business.

This is a hands-on role; you’ll collaborate with AI/ML and software teams to ensure reliable, high-quality data at scale, while enforcing data quality, governance and security across the data lifecycle.

Qualifications

• 5+ years of experience in Data Engineering, ETL development, data warehousing or similar roles.
• Hands-on ETL/ELT workflow design with Airflow, dbt, Luigi or equivalent.
• Strong Python and SQL skills; knowledge of Scala or Java a plus.
• Experience with big data architectures and large-scale pipelines.
• Cloud data environments across Azure, AWS or GCP.
• Experience handling large-scale structured and unstructured data.
• Data quality, governance, monitoring and engineering best practices.
• Problem-solving to diagnose performance and data issues.
• Bachelor’s degree in Computer Science, Engineering or related field.

Responsibilities

• Design, build and optimise scalable ETL/ELT pipelines.
• Develop data infrastructure for AI/ML workloads.
• Test, monitor and optimise pipelines for reliability and data integrity.
• Collaborate with AI/ML and software teams to provide accessible data.
• Maintain data architecture, lineage and metadata documentation.

Skills

ETL development

Python

SQL

Data pipeline design

Data governance

Education

Bachelors in CS/Engineering

Tools

Airflow

dbt

Luigi

Scala

Java

Job description

DISCOVERED partners with a leading financial services organisation in Abu Dhabi to advance its Data & AI capabilities. We seek an experienced Data Engineer to build scalable data infrastructure and pipelines powering AI/ML across the business.

This is a hands-on role; you’ll collaborate with AI/ML and software teams to ensure reliable, high-quality data at scale, while enforcing data quality, governance and security across the data lifecycle.