Databricks Platform Engineer: Data Infrastructure Lead

Zurich Insurance Group; Barcelona; Presencial; EUR 70.000 - 105.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Flexible working model

Work abroad up to 25 days yearly

Home office setup allowance

Training and language courses

Health Insurance

Descripción de la vacante

Zurich Insurance Group in Barcelona seeks a senior Data Engineer to own and evolve the Databricks platform, building scalable data ingestion pipelines across batch, streaming, API, and CDC sources. You will manage Delta Live Tables, Delta Lake, and Unity Catalog governance while collaborating with cloud, data, and product teams.

The role emphasizes Python/PySpark development, DevOps practices, and AWS-based infrastructure. A flexible working model and location in Barcelona are offered.

Formación

• 5–8 years in Data Engineering, Data Platform Engineering, or Cloud Data Architecture.
• 3+ years owning Databricks platforms in enterprise environments.
• Strong Python, PySpark and Databricks SQL for scalable pipelines.

Responsabilidades

• Own and evolve the Databricks platform underpinning Zurich's Global Finance Data Hub.
• Design and maintain data ingestion frameworks for batch, streaming, API, and CDC patterns.
• Develop and manage Delta Live Tables pipelines with data quality controls.
• Administer Delta Lake environments, perform tuning and optimization tasks.
• Implement Unity Catalog governance, access controls, and data lineage.

Conocimientos

Databricks platform ownership

PySpark

Python

CI/CD

DevOps practices

Airflow

Kafka/MSK

AWS

Herramientas

Unity Catalog

Delta Lake

Delta Live Tables

Workflows

Asset Bundles

CloudFormation

CDK

S3

CloudWatch

Grafana

Descripción del empleo

Zurich Insurance Group in Barcelona seeks a senior Data Engineer to own and evolve the Databricks platform, building scalable data ingestion pipelines across batch, streaming, API, and CDC sources. You will manage Delta Live Tables, Delta Lake, and Unity Catalog governance while collaborating with cloud, data, and product teams.

The role emphasizes Python/PySpark development, DevOps practices, and AWS-based infrastructure. A flexible working model and location in Barcelona are offered.