Senior Databricks Architect (Azure) – Delta Lake & Unity

Marc Ellis; Doha; On-site; QAR 437,000 - 619,000; Full time

Job summary

Marc Ellis in Doha, Qatar seeks a Senior Databricks Specialist / Data Architect to lead enterprise data platforms using Azure Databricks, Spark, and Delta Lake. You will govern data pipelines, implement Unity Catalog, and optimize performance across large datasets.

The role requires 8+ years in data engineering/architecture, 4+ years with Azure Databricks, and strong experience with Unity Catalog and Medallion Architecture. 12-month extendable contract on Marc Ellis payroll.

Qualifications

• Bachelor's degree in Computer Science, Data Science, IT, Software Engineering, or related field.
• 8+ years in data engineering, data architecture, or big data systems.
• 4+ years hands-on experience with Microsoft Azure Databricks.
• Deep knowledge of Unity Catalog, Delta Lake, and Medallion Architecture.

Responsibilities

• Design and optimize enterprise-scale data platforms on Azure Databricks.
• Build high-performance data pipelines using Spark and PySpark.
• Architect Delta Lake storage and Medallion Architecture (Bronze-Silver-Gold).
• Implement Unity Catalog governance, access controls, and data lineage.
• Integrate with Dynamics 365 CRM and other core systems, APIs, and data sources.
• Develop CI/CD pipelines and IaC using Azure DevOps and Git.
• Tune performance, reduce costs, and troubleshoot complex data issues.

Skills

Azure Databricks

Apache Spark

Delta Lake

Unity Catalog

PySpark

SQL

Azure Data Factory

Azure Data Lake Storage Gen2

CI/CD pipelines

Azure DevOps

Education

Bachelor's degree in Computer Science or related field

Tools

Azure DevOps

Git

Dynamics 365 CRM

Python

Job description

Marc Ellis in Doha, Qatar seeks a Senior Databricks Specialist / Data Architect to lead enterprise data platforms using Azure Databricks, Spark, and Delta Lake. You will govern data pipelines, implement Unity Catalog, and optimize performance across large datasets.

The role requires 8+ years in data engineering/architecture, 4+ years with Azure Databricks, and strong experience with Unity Catalog and Medallion Architecture. 12-month extendable contract on Marc Ellis payroll.