Data Engineer

Client of AIQU; Abu Dhabi; On-site; AED 350,000 - 550,000; Full time

Job summary

Client of AIQU seeks a seasoned Data Engineer in Dubai with 8+ years to design and optimize scalable data platforms using Databricks and SQL. You will build robust ETL pipelines, ensure data quality, and support analytics and BI initiatives while mentoring junior engineers.

You will collaborate with cross-functional teams to translate business requirements into technical solutions and contribute to data modeling, metadata management, and security practices across cloud environments.

Qualifications

• 8+ years of professional data engineering experience.
• Proficiency in Databricks and Apache Spark for large-scale data processing.
• Expert-level SQL skills for query writing, tuning, and optimization.
• Strong programming experience in Python or Scala.
• Hands-on experience designing and implementing ETL pipelines.
• Solid understanding of data modeling, warehousing concepts, and metadata management.
• Experience working with cloud platforms such as Azure or AWS.
• Excellent problem-solving, communication, and stakeholder management skills.

Responsibilities

• Design, develop, and maintain scalable ETL pipelines using Databricks and Spark.
• Write, optimize, and troubleshoot complex SQL queries for data extraction and transformation.
• Collaborate with data analysts, scientists, and stakeholders to gather requirements and deliver data solutions.
• Implement data modeling, schema design, and metadata management best practices.
• Monitor data pipeline performance, identify bottlenecks, and implement optimizations.
• Ensure data quality, integrity, and security through automated testing and validation.
• Document data flows, architecture diagrams, and operational processes.
• Mentor and coach junior data engineers, sharing best practices and conducting code reviews.

Skills

Databricks

Apache Spark

SQL

Python/Scala

ETL pipelines

data modeling

warehousing

Azure/AWS

problem solving

communication

Tools

Snowflake

Kafka

Docker

Kubernetes

Job description

About the Role:

We are seeking a seasoned Data Engineer based in Dubai with 8 10 years of experience to design, build, and optimize scalable data platforms. You will leverage Databricks and SQL to develop robust ETL pipelines, ensure data quality, and support analytics and BI initiatives. In this role, you will collaborate with cross-functional teams to translate business requirements into technical solutions and mentor junior engineers.

Responsibilities:

• Design, develop, and maintain scalable ETL pipelines using Databricks and Spark
• Write, optimize, and troubleshoot complex SQL queries for data extraction and transformation
• Collaborate with data analysts, scientists, and stakeholders to gather requirements and deliver data solutions
• Implement data modeling, schema design, and metadata management best practices
• Monitor data pipeline performance, identify bottlenecks, and implement optimizations
• Ensure data quality, integrity, and security through automated testing and validation
• Document data flows, architecture diagrams, and operational processes
• Mentor and coach junior data engineers, sharing best practices and conducting code reviews

Desired Candidate Profile

Required Qualifications:

• 8 10 years of professional data engineering experience
• Proficiency in Databricks and Apache Spark for large-scale data processing
• Expert-level SQL skills for query writing, tuning, and optimization
• Strong programming experience in Python or Scala
• Hands-on experience designing and implementing ETL pipelines
• Solid understanding of data modeling, warehousing concepts, and metadata management
• Experience working with cloud platforms such as Azure or AWS
• Excellent problem-solving, communication, and stakeholder management skills

Preferred Qualifications:

• Experience with Snowflake or other cloud data warehouses
• Familiarity with real-time data streaming technologies (e.g., Kafka)
• Certifications in Azure Data Engineer or AWS Data Analytics
• Knowledge of data governance, lineage, and compliance frameworks
• Exposure to containerization and orchestration tools (Docker, Kubernetes)
• Experience in agile software development and DevOps practices

Position Details

• Position Title: Data Engineer
• Location: DUBAI, united arab emirates
• Industry: Automotive
• Experience Required: 8+ years