Azure Databricks Architect & Data Platform Lead

Employment; Doha; Vor Ort; QAR 300.000 - 520.000; Vollzeit

Zusammenfassung

Employment is seeking a hands-on Senior Databricks Specialist / Data Architect to design and govern enterprise data solutions on Azure Databricks. The role focuses on scalable ETL/ELT pipelines, Medallion Architecture, and Delta Lake optimization, with governance, security, and performance at the forefront.

You will define platform standards, integrate with enterprise apps like Dynamics 365, and support Power BI and analytics platforms through optimized data models.

Qualifikationen

• 8+ years in data engineering or data architecture.
• 4+ years with Azure Databricks.
• Strong Spark and PySpark experience.
• Delta Lake and Unity Catalog expertise.
• Experience with data governance, security, and lineage.
• CI/CD, Git, and Azure DevOps proficiency.

Aufgaben

• Design enterprise-scale data solutions on Azure Databricks.
• Define Databricks data architecture and platform standards.
• Ingest and integrate data from multiple sources.
• Develop scalable ETL/ELT pipelines with Spark.
• Implement Medallion Architecture and Delta Lake optimization.
• Partner with Power BI and other analytics tools.
• Ensure data quality, governance, and security; enable CI/CD.

Kenntnisse

Azure Databricks

Apache Spark

PySpark

Data modeling

Data governance

CI/CD

Git

Azure DevOps

Security controls

Performance optimization

Tools

Delta Lake

Unity Catalog

Azure Data Factory

Azure Data Lake Storage Gen2

Jobbeschreibung

Employment is seeking a hands-on Senior Databricks Specialist / Data Architect to design and govern enterprise data solutions on Azure Databricks. The role focuses on scalable ETL/ELT pipelines, Medallion Architecture, and Delta Lake optimization, with governance, security, and performance at the forefront.

You will define platform standards, integrate with enterprise apps like Dynamics 365, and support Power BI and analytics platforms through optimized data models.