Databricks Platform Engineer — Hybrid (Barcelona)

Zurich Insurance; Barcelona; Hybrid; EUR 70,000 - 95,000; Full time

Benefits offered by this job

Competitive salary

Yearly bonus

Flexible working model

Work abroad up to 25 days yearly

Home office setup allowance (>€300)

Job summary

Zurich Insurance Group, Barcelona Technology Delivery Center, is seeking a Databricks Platform Engineer to own and evolve the Databricks platform for the Global Finance Data Hub. You will design, build, and maintain ingestion pipelines across multiple sources, and enforce data quality and governance.

The role requires 5–8 years in data engineering, strong PySpark/Python skills, and IaC with CloudFormation or CDK. Hybrid work in Barcelona is offered with competitive compensation and annual bonus.

Qualifications

• 5-8 years of experience in Data Engineering or Cloud Data Architecture.
• 3+ years owning and managing Databricks platforms in enterprise environments.
• Strong expertise in Unity Catalog, Delta Lake, Delta Live Tables, Workflows and Asset Bundles.
• Experience designing batch, streaming, API, and CDC data ingestion frameworks.
• Advanced PySpark, Python, and Databricks SQL for scalable pipelines.
• DevOps practices with Git-based development, CI/CD and IaC (CloudFormation or CDK).
• Strong AWS experience (S3, IAM, networking, security, secrets).
• Experience with regulated industries, financial services is a plus.

Responsibilities

• Own and evolve the Databricks platform underpinning the Zurich Global Finance Data Hub.
• Design, build, and maintain data ingestion frameworks across source systems.
• Develop and manage Delta Live Tables pipelines with quality controls and change data capture.
• Administer and optimise Delta Lake environments, including time travel and VACUUM.
• Implement Unity Catalog governance including access controls and data lineage.
• Build, deploy, and support Databricks Workflows for orchestration and retries.
• Establish CI/CD pipelines using Git-based practices and Databricks Asset Bundles.
• Collaborate with cloud and infra teams; apply IaC via CloudFormation or CDK.

Skills

Databricks

PySpark

Python

CI/CD

Git-based development

AWS

CI/CD Pipelines

Infrastructure as Code

Tools

Delta Lake

Delta Live Tables

Unity Catalog

Databricks Workflows

CloudFormation

CDK

IAM

S3

Grafana

CloudWatch

Job description

Zurich Insurance Group, Barcelona Technology Delivery Center, is seeking a Databricks Platform Engineer to own and evolve the Databricks platform for the Global Finance Data Hub. You will design, build, and maintain ingestion pipelines across multiple sources, and enforce data quality and governance.

The role requires 5–8 years in data engineering, strong PySpark/Python skills, and IaC with CloudFormation or CDK. Hybrid work in Barcelona is offered with competitive compensation and annual bonus.