Senior Azure Databricks Architect

Malomatia

Doha

Presencial

QAR 300.000 - 420.000

Tempo integral

Há 4 dias
Seja uma das primeiras pessoas a se candidatar

Uma candidatura completa em um minuto

Currículo e carta de apresentação personalizados, prontos para serem enviados.

Passe pelos filtros ATS

Resumo da vaga

Malomatia in Doha is seeking a hands-on senior Databricks specialist to independently design, develop, troubleshoot, optimize, and govern Databricks solutions in production enterprise environments.

Responsibilities include designing enterprise-scale data solutions, data architecture, ingestion pipelines, ETL/ELT with Spark, Medallion architecture, Delta Lake optimization, data modeling, and data governance. Strong expertise in Azure data services and CI/CD is required.

Qualificações

  • Minimum 8+ years of experience in data engineering/data architecture.
  • Minimum 4+ years of hands-on experience with Azure Databricks.
  • Strong hands-on experience with Apache Spark and PySpark.
  • Strong experience with Delta Lake.
  • Strong experience designing enterprise data platforms and data pipelines.
  • Strong knowledge of Databricks Medallion Architecture.
  • Strong experience with Unity Catalog, data governance, access control, and data lineage.
  • Strong SQL skills and experience with large-scale data processing.
  • Strong experience with Azure data services.
  • Experience with Azure Data Factory / Azure Data Lake Storage Gen2.
  • Experience integrating Databricks with APIs, enterprise apps, CRM systems, and other data sources.
  • Experience with data modeling and dimensional modeling.
  • Strong understanding of data quality and governance.
  • Strong understanding of performance optimization and Databricks cost optimization.
  • Experience with CI/CD, Git, Azure DevOps, and deployment automation.
  • Experience working with large-volume enterprise datasets.
  • Ability to troubleshoot complex production data issues.

Responsabilidades

  • Design and implement enterprise-scale data solutions using Azure Databricks.
  • Define and maintain Databricks data architecture and platform standards.
  • Design data ingestion and integration pipelines from multiple source systems.
  • Develop scalable ETL/ELT pipelines using Databricks and Apache Spark.
  • Design and implement Medallion Architecture (Bronze, Silver, Gold) where appropriate.
  • Work with Delta Lake and optimize Delta tables and data pipelines.
  • Design data models and transformation processes for analytical and operational reporting.
  • Integrate Databricks with Microsoft Dynamics 365 / Dataverse and other enterprise applications.
  • Develop and optimize batch and near-real-time data processing pipelines.
  • Implement data quality, validation, monitoring, lineage, and governance processes.
  • Optimize Spark jobs, clusters, SQL queries, Delta tables, and data pipelines for performance and cost.
  • Implement appropriate data security and access controls.
  • Work with Unity Catalog for data governance, access control, cataloging, and lineage.
  • Support Power BI and other analytical/reporting platforms through optimized data models and data services.
  • Troubleshoot complex data engineering and performance issues.
  • Establish development, testing, and production standards for Databricks.
  • Support CI/CD and DevOps practices for Databricks solutions.
  • Conduct technical reviews and mentor data engineers.
  • Ensure data platform solutions meet security, availability, scalability, and disaster recovery requirements.

Descrição da vaga

Malomatia in Doha is seeking a hands-on senior Databricks specialist to independently design, develop, troubleshoot, optimize, and govern Databricks solutions in production enterprise environments.

Responsibilities include designing enterprise-scale data solutions, data architecture, ingestion pipelines, ETL/ELT with Spark, Medallion architecture, Delta Lake optimization, data modeling, and data governance. Strong expertise in Azure data services and CI/CD is required.

Obtenha sua revisão de currículo grátis e confidencial.

ou arraste e solte seu arquivo aqui.

Similar jobs

Vagas similares que valem a pena comparar

Azure Databricks Architect & Data Platform Lead
Azure Databricks Architect & Data Platform Lead

Employment • Doha

Presencial
QAR 300.000 - 520.000
Senior Databricks Specialist / Data Architect
Senior Databricks Specialist / Data Architect

Employment • Doha

Presencial
QAR 300.000 - 520.000
Senior Databricks Specialist / Data Architect
Senior Databricks Specialist / Data Architect

Malomatia • Doha

Presencial
QAR 300.000 - 420.000
Senior Databricks Architect (Azure) – Delta Lake & Unity
Senior Databricks Architect (Azure) – Delta Lake & Unity

Marc Ellis • Doha

Presencial
QAR 437.000 - 619.000
Senior Data Engineer
Senior Data Engineer

Malomatia • Doha

Presencial
QAR 250.000 - 400.000
Senior Databricks Specialist/Data Architect | Marc Ellis | Doha, Qatar
Senior Databricks Specialist/Data Architect | Marc Ellis | Doha, Qatar

Marc Ellis • Doha

Presencial
QAR 437.000 - 619.000
Senior Data Engineer - AI-Driven Data Pipelines
Senior Data Engineer - AI-Driven Data Pipelines

Management Solutions International • Doha

Presencial
QAR 300.000 - 540.000
Senior Data Engineer - Lakehouse & ETL Architect
Senior Data Engineer - Lakehouse & ETL Architect

Malomatia • Doha

Presencial
QAR 250.000 - 400.000
Doha Senior Data Engineer — AI Pipelines for Fintech
Doha Senior Data Engineer — AI Pipelines for Fintech

Alpha10x • Doha

Presencial
QAR 180.000 - 300.000
Data & AI Project Delivery Lead
Data & AI Project Delivery Lead

Malomatia • Doha

Presencial
QAR 300.000 - 540.000
Principais localizações