Senior Data Engineer — Databricks ETL & Data Platforms

Client of AIQU; Abu Dhabi; On-site; AED 350,000 - 550,000; Full time

Job summary

Client of AIQU seeks a seasoned Data Engineer in Dubai with 8+ years to design and optimize scalable data platforms using Databricks and SQL. You will build robust ETL pipelines, ensure data quality, and support analytics and BI initiatives while mentoring junior engineers.

You will collaborate with cross-functional teams to translate business requirements into technical solutions and contribute to data modeling, metadata management, and security practices across cloud environments.

Qualifications

• 8+ years of professional data engineering experience.
• Proficiency in Databricks and Apache Spark for large-scale data processing.
• Expert-level SQL skills for query writing, tuning, and optimization.
• Strong programming experience in Python or Scala.
• Hands-on experience designing and implementing ETL pipelines.
• Solid understanding of data modeling, warehousing concepts, and metadata management.
• Experience working with cloud platforms such as Azure or AWS.
• Excellent problem-solving, communication, and stakeholder management skills.

Responsibilities

• Design, develop, and maintain scalable ETL pipelines using Databricks and Spark.
• Write, optimize, and troubleshoot complex SQL queries for data extraction and transformation.
• Collaborate with data analysts, scientists, and stakeholders to gather requirements and deliver data solutions.
• Implement data modeling, schema design, and metadata management best practices.
• Monitor data pipeline performance, identify bottlenecks, and implement optimizations.
• Ensure data quality, integrity, and security through automated testing and validation.
• Document data flows, architecture diagrams, and operational processes.
• Mentor and coach junior data engineers, sharing best practices and conducting code reviews.

Skills

Databricks

Apache Spark

SQL

Python/Scala

ETL pipelines

data modeling

warehousing

Azure/AWS

problem solving

communication

Tools

Snowflake

Kafka

Docker

Kubernetes

Job description

Client of AIQU seeks a seasoned Data Engineer in Dubai with 8+ years to design and optimize scalable data platforms using Databricks and SQL. You will build robust ETL pipelines, ensure data quality, and support analytics and BI initiatives while mentoring junior engineers.

You will collaborate with cross-functional teams to translate business requirements into technical solutions and contribute to data modeling, metadata management, and security practices across cloud environments.