Senior Azure Databricks Architect - Data Platform Lead

Arab Solutions; Qatar; On-site; QAR 320,000 - 700,000; Full time

Job summary

Arab Solutions is seeking a Senior Databricks Specialist to lead the design and optimization of an enterprise Databricks platform in Qatar. You will architect data pipelines, governance, and integration with enterprise systems, including Dynamics 365.

The role requires hands-on expertise and leadership in a large-scale Azure environment. Responsibilities include building scalable ETL/ELT pipelines, applying Medallion Architecture, and ensuring performance, security, and cost efficiency while

Qualifications

• Minimum 8+ years of experience in data engineering/data architecture.
• Minimum 4+ years of hands-on experience with Azure Databricks.
• Strong hands-on experience with Apache Spark and PySpark.
• Strong experience with Delta Lake and data governance.

Responsibilities

• Design and implement enterprise-scale data solutions using Azure Databricks.
• Define and maintain Databricks data architecture and platform standards.
• Design data ingestion and integration pipelines from multiple source systems.
• Develop scalable ETL/ELT pipelines using Databricks and Apache Spark.
• Design and implement Medallion Architecture (Bronze, Silver, Gold) where appropriate.
• Work with Delta Lake and optimize Delta tables and data pipelines.

Skills

Azure Databricks

Apache Spark

PySpark

Delta Lake

Data Modeling

SQL

Data Governance

CI/CD

Power BI integration

Tools

Azure Databricks

Unity Catalog

Azure Data Factory

Azure Data Lake Storage Gen2

Power BI

Delta Lake

Job description

Arab Solutions is seeking a Senior Databricks Specialist to lead the design and optimization of an enterprise Databricks platform in Qatar. You will architect data pipelines, governance, and integration with enterprise systems, including Dynamics 365.

The role requires hands-on expertise and leadership in a large-scale Azure environment. Responsibilities include building scalable ETL/ELT pipelines, applying Medallion Architecture, and ensuring performance, security, and cost efficiency while