Senior Data Engineer – Databricks, Spark & ETL Leader (Dubai)

Client of AIQU; United Arab Emirates; On-site; AED 350,000 - 520,000; Full time

Job summary

Client of AIQU in Dubai is seeking a seasoned Data Engineer with 8+ years to design, build and optimize scalable data platforms. You will leverage Databricks and SQL to develop robust ETL pipelines, ensure data quality and support analytics initiatives.

Collaboration with cross-functional teams and mentoring junior engineers are key parts of this role. The role emphasizes hands-on data modeling, warehousing concepts, metadata management and best-practice data governance on cloud platforms such

Qualifications

• 8–10 years of professional data engineering experience.
• Proficiency in Databricks and Apache Spark for large-scale data processing.
• Expert-level SQL skills for query writing, tuning, and optimization.
• Strong programming experience in Python or Scala.

Responsibilities

• Design, develop and maintain scalable ETL pipelines using Databricks and Spark.
• Write, optimize and troubleshoot complex SQL queries for data extraction and transformation.
• Collaborate with data analysts, scientists and stakeholders to gather requirements and deliver data solutions.
• Implement data modeling, schema design and metadata management best practices.
• Monitor data pipeline performance, identify bottlenecks and optimize processes.
• Ensure data quality, integrity and security through automated testing and validation.
• Document data flows, architectures and operational processes.
• Mentor and coach junior data engineers, share best practices and conduct code reviews.

Skills

Databricks

Apache Spark

SQL

Python

Scala

ETL pipelines

Data modeling

Warehousing concepts

Metadata management

Azure

AWS

Tools

Snowflake

Kafka

Docker

Kubernetes

Job description

Client of AIQU in Dubai is seeking a seasoned Data Engineer with 8+ years to design, build and optimize scalable data platforms. You will leverage Databricks and SQL to develop robust ETL pipelines, ensure data quality and support analytics initiatives.

Collaboration with cross-functional teams and mentoring junior engineers are key parts of this role. The role emphasizes hands-on data modeling, warehousing concepts, metadata management and best-practice data governance on cloud platforms such