Senior Databricks Administrator/Architect

EUROPEAN DYNAMICS

España

A distancia

EUR 90.000 - 120.000

Jornada completa

14 días+

Consigue una respuesta de este empleador

Tu currículum y tu carta de presentación, adaptados exactamente a lo que buscan contratar.

Supera los filtros ATS

Descripción de la vacante

European Dynamics is seeking a Senior Databricks Administrator/Architect to join our Development team in a remote capacity. You will work closely with a major client’s IT team to design and deploy scalable data platforms on Azure Databricks, Delta Lake, and Unity Catalog, while implementing security, governance, and CI/CD practices.

The role requires extensive experience with PySpark, SQL, Terraform/Bicep, and Azure services, including governance, monitoring, and cost optimization.

Formación

  • University degree in IT or equivalent with professional IT experience.
  • 9+ years designing and implementing enterprise data platforms.
  • 5+ years hands-on Azure Databricks in enterprise environments.
  • Experience with Lakehouse architectures using Azure Databricks.
  • Administering Databricks workspaces, Unity Catalog, and security.
  • Strong SQL and Python (PySpark) development skills.
  • Experience with IaC (Terraform/Bicep) and CI/CD (Azure DevOps).
  • Knowledge of RBAC, PIM, Key Vault, private endpoints, encryption.
  • Familiarity with data governance, data lineage, and metadata management.

Responsabilidades

  • Collaborate with Data Platforms to architect scalable enterprise data platforms.
  • Administer Databricks workspaces, clusters, Unity Catalog, and security.
  • Define and implement enterprise security and data governance standards.
  • Develop CI/CD pipelines with Azure DevOps and DAB for deployments.
  • Tune Databricks workloads, optimize Spark, and control costs.
  • Design monitoring, dashboards, and platform health metrics.
  • Support migration of legacy warehouses to Azure Databricks and Lakehouse.
  • Provide troubleshooting for production incidents related to Databricks.

Conocimientos

Azure Databricks
Delta Lake
Unity Catalog
Azure Data Lake Storage Gen2
Azure Data Factory
Azure Event Hub
Azure SQL
Azure Monitor
Spark / PySpark
Python
RBAC / PIM
Key Vault
Terraform / Bicep
Azure DevOps
CI/CD pipelines
Data Governance
Data Modeling (Dimensional / DataVault
Security Architecture
Monitoring / Observability

Educación

University degree (IT related)

Herramientas

Azure Databricks
Terraform / IaC
Databricks Asset Bundles
Unity Catalog
Azure DevOps

Descripción del empleo

We currently have a vacancy for a Senior Databricks Administrator/Architect fluent in English, to offer his/her services as an expert remotely. In the context of the first assignment, the successful candidate will be integrated in the Development team of the company that will closely cooperate with a major client's IT team.

Your tasks:
  • Collaborate with Data Platforms and Integration team in architecting and implementing scalable enterprise data platform solutions utilizing Azure Databricks, Delta Lake, Unity Catalog, Azure Data Lake Storage Gen2, Azure Data Factory, Azure Event Hub, Azure SQL, and related Azure services;
  • Design and develop enterprise data engineering frameworks supporting batch, streaming, ELT/ETL, and real-time analytics workloads;
  • Administer and maintain Azure Databricks workspaces including cluster configuration, job scheduling, workspace administration, Unity Catalog implementation, secret management, compute policies, cluster policies, and workspace governance;
  • Define and implement enterprise security architecture including identity integration with Microsoft Entra ID (Azure AD), Role-Based Access Control (RBAC), Privileged Identity Management (PIM), data encryption, private networking, managed identities, Key Vault integration, and secure access patterns;
  • Establish enterprise data governance standards utilizing Unity Catalog including data lineage, data quality, metadata management, catalog organization, access policies, and audit capabilities;
  • Deploy and Configure CI/CD pipelines utilizing Azure DevOps and Databricks Asset Bundles (DAB), Infrastructure as Code (Terraform/Bicep where applicable), deployment automation, release management, and environment promotion strategies;
  • Optimize Databricks workloads through performance tuning, Spark optimization, cluster sizing, workload isolation, caching strategies, partitioning, Delta optimization, Photon, and cost optimization best practices;
  • Design enterprise monitoring, logging, operational dashboards, alerting, and platform health monitoring utilizing Azure Monitor, Log Analytics, Application Insights, and Databricks system tables;
  • Develop reusable architecture patterns, reference implementations, development standards, naming conventions, coding standards, operational procedures, and platform documentation;
  • Support migration of legacy enterprise data warehouses, ETL solutions, and reporting platforms to Azure Databricks and modern Lakehole architecture;
  • Provide technical support and troubleshooting for production incidents related to Azure Databricks, Spark workloads, data pipelines, and platform infrastructure.
Qualifications and Experience:
  • University degree in combined with relevant IT professional experience of 9 years;
  • At least 8 years of experience in designing and implementing enterprise data platforms;
  • At least 5 years of hands‑on experience hands‑on Azure Databricks experience in enterprise environments;
  • Experience with architecting modern Lakehouse solutions using Azure Databricks and Delta Lake;
  • Experience in administering Azure Databricks workspaces, clusters, Unity Catalog, compute policies, job orchestration, and workspace security;
  • Experience in developing data engineering solutions using Apache Spark (PySpark and/or Spark SQL);
  • Experience in implementing enterprise data governance utilizing Unity Catalog, metadata management, data lineage, and fine‑grained access controls;
  • Experience implementing Infrastructure as Code using Terraform and/or Bicep;
  • Strong experience implementing CI/CD pipelines utilizing Azure DevOps, automated testing, release management, and deployment automation;
  • Experience designing and working with enterprise security architectures including RBAC, Managed Identities, Private Endpoints, Key Vault integration, encryption, and network security;
  • Experience implementing enterprise data quality frameworks, monitoring, observability, and operational dashboards;
  • Strong understanding of data modelling techniques including dimensional modelling, Data Vault, medallion architecture, and enterprise data warehouse concepts;
  • Strong knowledge of Azure Data Lake Storage Gen2, Azure Data Factory, Azure Event Hub, Azure SQL Database, Azure Key Vault, Azure Monitor, Microsoft Entra ID (Azure AD), and Azure networking;
  • Strong SQL programming skills and proficiency in Python and PySpark development;
  • Knowledge of AI/ML workloads, Databricks ML, Feature Store, Model Serving, and Generative AI architectures is considered an asset;
  • Experience with Power BI, Microsoft Fabric, Synapse Analytics, or other enterprise analytics platforms is highly desirable;
  • Experience working within large international organizations, NGOs, or United Nations agencies is desirable;
  • The following certifications are desirable: Databricks Certified Platform, Architecture/Microsoft Azure Solution Architecture Expert/Databricks, Certified Data Engineer Associate/Professional;
  • Excellent command of the English language.
Additional:

If you are seeking a career in an exciting and dynamic company, w

Consigue la evaluación confidencial y gratuita de tu currículum.

o arrastra y suelta tu archivo aquí

Similar jobs

Puestos de trabajo similares que vale la pena comparar

Senior Databricks Administrator/Architect
Senior Databricks Administrator/Architect

EUROPEAN DYNAMICS Group • Valencia

Híbrido
EUR 90.000 - 130.000
Remote work
Competitive remuneration
Senior Databricks Administrator/Architect
Senior Databricks Administrator/Architect

European Dynamics • Madrid

A distancia
EUR 90.000 - 120.000
Remote Senior Databricks Architect & Data Platform Lead
Remote Senior Databricks Architect & Data Platform Lead

EUROPEAN DYNAMICS • España

A distancia
EUR 90.000 - 120.000
Senior Data Architect
Senior Data Architect

Sowelo Consulting sp. z o.o. • España

A distancia
EUR 90.000 - 130.000
Remote in Spain
Flexible hours
B2B contract
Senior Data Engineer
Senior Data Engineer

Intellias • España

A distancia
EUR 90.000 - 140.000
Senior Azure Databricks Architect & Platform Lead (Remote)
Senior Azure Databricks Architect & Platform Lead (Remote)

EUROPEAN DYNAMICS Group • Madrid

A distancia
EUR 90.000 - 120.000
DATABRICKS Data Architect
DATABRICKS Data Architect

Devoteam • Comunidad de Madrid

Presencial
EUR 90.000 - 130.000
Competitive salary
Annual performance bonus
Flexible compensation package (transit
+3
DATABRICKS Data Architect
DATABRICKS Data Architect

Devoteam • Madrid

Presencial
EUR 80.000 - 110.000
Competitive salary
Annual performance bonus
Flexible compensation package
+1
Databricks Data Architect (m/f/d)
Databricks Data Architect (m/f/d)

synvert • Bellprat

Híbrido
EUR 60.000 - 90.000
Flexible benefits plan: health, travel
Childcare vouchers
23 vacation days + Dec 24/31
DATABRICKS Data Architect
DATABRICKS Data Architect

Devoteam • España

A distancia
EUR 65.000 - 95.000
Annual performance bonus
Flexible compensation package
Health insurance
+3