Senior Azure Databricks Architect & Platform Lead (Remote)

EUROPEAN DYNAMICS Group; Madrid; Teletrabalho; EUR 90 000 - 120 000; Tempo integral

Resumo da oferta

EUROPEAN DYNAMICS Group seeks a Senior Databricks Administrator/Architect fluent in English to join the Development team and work remotely on enterprise data platform solutions for a major client. You will architect, implement, and govern Azure Databricks-based data pipelines and Lakehouse solutions, collaborate with international IT teams, and optimize performance and security.

The role requires strong Azure Databricks, Spark, and governance skills, with extensive experience in PySpark/SQL,

Qualificações

• University degree in IT or related field with extensive IT experience.
• At least 8 years designing and implementing enterprise data platforms.
• 5+ years hands-on Azure Databricks experience in enterprise environments.
• Experience with modern Lakehouse solutions using Azure Databricks and Delta Lake.
• Experience administering Databricks workspaces, clusters, Unity Catalog and security.

Responsabilidades

• Collaborate with Data Platforms and Integration teams to architect and implement scalable enterprise data platform solutions on Azure Databricks.
• Design and develop data engineering frameworks supporting batch, streaming, ELT/ETL, and real-time analytics.
• Administer and maintain Databricks workspaces, Unity Catalog, secret management, and security policies.
• Define and implement enterprise security architecture including Azure AD, RBAC, Key Vault integration, and private networking.
• Establish data governance standards using Unity Catalog including lineage, metadata, and access controls.
• Deploy CI/CD pipelines using Azure DevOps and Databricks Asset Bundles; use Terraform/Bicep for IaC.
• Optimize workloads with tuning, partitioning, Delta optimization, and cost-control practices.
• Design monitoring, logging, dashboards, alerts using Azure Monitor and Databricks system tables.
• Develop architecture patterns, standards, and platform documentation.
• Support migration of legacy warehouses to Databricks and Lakehouse architectures.
• Provide production support for Databricks, Spark workloads, and data pipelines.

Conhecimentos

Azure Databricks

Python

PySpark

SQL

English fluency

Formação académica

University degree in IT/related field

Ferramentas

Azure Databricks

Delta Lake

Unity Catalog

Azure Data Lake Storage Gen2

Azure Data Factory

Terraform

Bicep

Azure DevOps

Databricks Asset Bundles

Power BI

Descrição da oferta de emprego

EUROPEAN DYNAMICS Group seeks a Senior Databricks Administrator/Architect fluent in English to join the Development team and work remotely on enterprise data platform solutions for a major client. You will architect, implement, and govern Azure Databricks-based data pipelines and Lakehouse solutions, collaborate with international IT teams, and optimize performance and security.

The role requires strong Azure Databricks, Spark, and governance skills, with extensive experience in PySpark/SQL,