Data Engineer - Scalable Pipelines on Databricks

Rakbank; United Arab Emirates; On-site; AED 180,000 - 260,000; Full time

Job summary

Rakbank is seeking a Data Engineer to join our Data & Analytics team in the UAE. You will design and maintain scalable data pipelines on the Databricks Lakehouse platform, enabling analytics, regulatory reporting, and AI initiatives.

You will build curated datasets, implement data quality controls, and work across batch and streaming workloads. Collaboration with architects, governance teams, and stakeholders is essential to deliver trusted data products within an Agile environment.

Qualifications

• 3-7 years of experience in Data Engineering, Analytics Engineering, Software Engineering, or a related field.
• Strong hands-on experience with SQL, Python, PySpark, and Spark SQL.
• Experience working with Databricks, Delta Lake, Databricks Workflows, and Databricks SQL.
• Knowledge of Azure Data Factory (ADF), dbt, CDC frameworks, and streaming technologies such as Kafka/Confluent.
• Understanding of dimensional modelling, medallion architecture, data quality frameworks, and data governance principles.
• Familiarity with Git, CI/CD practices, and Agile delivery methodologies.
• Strong problem-solving, collaboration, and communication skills.
• Banking or financial services experience is advantageous.
• Azure or Databricks certifications will be an added advantage.

Responsibilities

• Design, build, deploy, and maintain scalable data pipelines on the Databricks Lakehouse platform.
• Develop and optimize data ingestion, transformation, and enrichment processes across batch, streaming, and near-real-time workloads.
• Build and maintain curated datasets and data models that support business intelligence, analytics, regulatory reporting, and AI use cases.
• Implement data quality controls, monitoring, reconciliations, and automated testing frameworks.
• Support migration of legacy data solutions into modern cloud-based data platforms.
• Troubleshoot production issues, perform root-cause analysis, and continuously improve platform reliability.
• Collaborate with architects, analysts, governance teams, and business stakeholders to deliver trusted data products.
• Contribute to Agile delivery practices using Azure DevOps, CI/CD, and engineering best practices.

Skills

SQL

Python

PySpark

Spark SQL

Tools

Databricks

Delta Lake

Databricks Workflows

Databricks SQL

Azure Data Factory

dbt

Kafka/Confluent

Git

Job description

Rakbank is seeking a Data Engineer to join our Data & Analytics team in the UAE. You will design and maintain scalable data pipelines on the Databricks Lakehouse platform, enabling analytics, regulatory reporting, and AI initiatives.

You will build curated datasets, implement data quality controls, and work across batch and streaming workloads. Collaboration with architects, governance teams, and stakeholders is essential to deliver trusted data products within an Agile environment.