Remote Azure Databricks Architect & Data Platform Lead

EUROPEAN DYNAMICS Group; Comunidad Valenciana; Remote; EUR 90,000 - 130,000; Full time

Job summary

EUROPEAN DYNAMICS (ED) is seeking a Senior Databricks Administrator/Architect to work remotely with our Development team, collaborating closely with a major IT client. Strong English is required as you design and implement scalable Databricks Lakehouse solutions on Azure, including security, governance, and CI/CD automation.

The role involves architecting data platforms, optimizing Spark workloads, and enabling seamless data movement across Delta Lake, Unity Catalog, and Azure services in an

Qualifications

• University degree with 9+ years IT-related experience.
• 8+ years designing and implementing enterprise data platforms.
• 5+ years hands-on Azure Databricks in large environments.
• Experience with Lakehouse using Azure Databricks and Delta Lake.
• Administering and securing Azure Databricks workspaces and Unity Catalog.
• Proficient in Spark (PySpark) and SQL.
• Infrastructure as Code with Terraform or Bicep.
• CI/CD with Azure DevOps; test and release automation.
• Enterprise security: RBAC, Private Endpoints, Key Vault.
• Data quality, monitoring, dashboards; observability.
• Data modeling: dimensional, Data Vault, medallion.
• Azure data services: Data Lake Gen2, Data Factory, Event Hub, SQL.
• English fluency; helpful AI/ML knowledge and tooling.

Responsibilities

• Collaborate with Data Platforms and Integration teams on scalable Azure Databricks solutions.
• Design data engineering frameworks for batch, streaming, ELT/ETL, and real-time analytics.
• Administer Azure Databricks workspaces, clusters, and Unity Catalog.
• Implement enterprise security architecture and access controls.
• Establish data governance standards with Unity Catalog and metadata management.
• Deploy CI/CD pipelines and IaC for deployment automation.
• Tune performance, optimize Spark workloads, and manage costs.
• Monitor platform health with Azure Monitor and Databricks tables.
• Develop reusable architecture patterns and documentation.
• Support migration of legacy warehouses to Databricks Lakehouse.

Skills

Azure Databricks

Databricks ML

PySpark/ Spark SQL

Azure Synapse/ Data Lake

CI/CD (Azure DevOps)

Terraform / Bicep

Security Architecture

Data Governance

Data Modeling (Dimensional/Data Vault)

Python

Education

University degree with relevant IT experience

Tools

Terraform

Bicep

Azure DevOps

Databricks

Power BI

Synapse Analytics

Microsoft Fabric

Job description

EUROPEAN DYNAMICS (ED) is seeking a Senior Databricks Administrator/Architect to work remotely with our Development team, collaborating closely with a major IT client. Strong English is required as you design and implement scalable Databricks Lakehouse solutions on Azure, including security, governance, and CI/CD automation.

The role involves architecting data platforms, optimizing Spark workloads, and enabling seamless data movement across Delta Lake, Unity Catalog, and Azure services in an