Data Engineer

Client of AIQU; United Arab Emirates; Presencial; AED 350.000 - 520.000; Jornada completa

Descripción de la vacante

Client of AIQU in Dubai is seeking a seasoned Data Engineer with 8+ years to design, build and optimize scalable data platforms. You will leverage Databricks and SQL to develop robust ETL pipelines, ensure data quality and support analytics initiatives.

Collaboration with cross-functional teams and mentoring junior engineers are key parts of this role. The role emphasizes hands-on data modeling, warehousing concepts, metadata management and best-practice data governance on cloud platforms such

Formación

• 8–10 years of professional data engineering experience.
• Proficiency in Databricks and Apache Spark for large-scale data processing.
• Expert-level SQL skills for query writing, tuning, and optimization.
• Strong programming experience in Python or Scala.

Responsabilidades

• Design, develop and maintain scalable ETL pipelines using Databricks and Spark.
• Write, optimize and troubleshoot complex SQL queries for data extraction and transformation.
• Collaborate with data analysts, scientists and stakeholders to gather requirements and deliver data solutions.
• Implement data modeling, schema design and metadata management best practices.
• Monitor data pipeline performance, identify bottlenecks and optimize processes.
• Ensure data quality, integrity and security through automated testing and validation.
• Document data flows, architectures and operational processes.
• Mentor and coach junior data engineers, share best practices and conduct code reviews.

Conocimientos

Databricks

Apache Spark

SQL

Python

Scala

ETL pipelines

Data modeling

Warehousing concepts

Metadata management

Azure

AWS

Herramientas

Snowflake

Kafka

Docker

Kubernetes

Descripción del empleo

About the Role

We are seeking a seasoned Data Engineer based in Dubai with 8 10 years of experience to design build and optimize scalable data platforms You will leverage Databricks and SQL to develop robust ETL pipelines ensure data quality and support analytics and BI initiatives In this role you will collaborate with cross-functional teams to translate business requirements into technical solutions and mentor junior engineers

Responsibilities

• Design develop and maintain scalable ETL pipelines using Databricks and Spark
• Write optimize and troubleshoot complex SQL queries for data extraction and transformation
• Collaborate with data analysts scientists and stakeholders to gather requirements and deliver data solutions
• Implement data modeling schema design and metadata management best practices
• Monitor data pipeline performance identify bottlenecks and implement optimizations
• Ensure data quality integrity and security through automated testing and validation
• Document data flows architecture diagrams and operational processes
• Mentor and coach junior data engineers sharing best practices and conducting code reviews

Required Qualifications:

• 8 10 years of professional data engineering experience
• Proficiency in Databricks and Apache Spark for large-scale data processing
• Expert-level SQL skills for query writing, tuning, and optimization
• Strong programming experience in Python or Scala
• Hands-on experience designing and implementing ETL pipelines
• Solid understanding of data modeling, warehousing concepts, and metadata management
• Experience working with cloud platforms such as Azure or AWS
• Excellent problem-solving, communication, and stakeholder management skills

Preferred Qualifications:

• Experience with Snowflake or other cloud data warehouses
• Familiarity with real-time data streaming technologies (e.g., Kafka)
• Certifications in Azure Data Engineer or AWS Data Analytics
• Knowledge of data governance, lineage, and compliance frameworks
• Exposure to containerization and orchestration tools (Docker, Kubernetes)
• Experience in agile software development and DevOps practices

Position Details

Position Title: Data Engineer
Location: DUBAI, united arab emirates
Industry: Automotive
Experience Required: 8+ years