Platform Engineer – Finance Data Platform (Databricks/AWS)

Enfint; Barcelona; Presencial; EUR 70.000 - 95.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Flexible working model

Option to work abroad up to 25 days a​

Home office allowance

Descripción de la vacante

Zurich Insurance Group's Technology Delivery Center in Barcelona is seeking a Senior Data Platform Engineer to own and evolve the Databricks platform, ensuring reliability, security, and cost efficiency. You will design and maintain batch and streaming ingestion pipelines, Delta Live Tables, and Delta Lake, plus Unity Catalog governance.

You will build CI/CD pipelines, Databricks Workflows, and collaborate with cloud, data engineering, architecture, and product teams to deliver a scalable

Formación

• 5-8 years in Data Engineering or Cloud Data Architecture.
• 3+ years owning and managing Databricks platforms in enterprise environments.
• Strong expertise with Unity Catalog, Delta Lake, Delta Live Tables, and Workflows.
• Proficient in PySpark, Python, and Databricks SQL for scalable pipelines.
• Solid DevOps knowledge: Git-based development, CI/CD, IaC.
• Excellent AWS experience: S3, IAM, networking, security controls.
• Experience in regulated industries is a plus.

Responsabilidades

• Own and evolve the Databricks platform ensuring scalability, reliability, security, and cost efficiency.
• Design, build, and maintain batch, streaming, API, and CDC data ingestion frameworks.
• Develop and manage Delta Live Tables pipelines with data quality and change data capture.
• Administer Delta Lake environments: performance tuning, schema evolution, VACUUM, OPTIMIZE.
• Implement Unity Catalog governance: access controls, data lineage, classification, namespaces.
• Build, deploy, and support Databricks Workflows for multi-task orchestration.
• Establish CI/CD pipelines using Git-based practices and Databricks Asset Bundles.
• Collaborate with cloud and infra teams to implement Infrastructure as Code (CloudFormation/CDK).
• Manage authentication/authorization: AWS IAM, secret management, rotation.
• Monitor platform health, costs, and performance with observability tools.

Conocimientos

Databricks

Unity Catalog

Delta Lake

Delta Live Tables

PySpark

Python

Databricks SQL

CI/CD

Git

AWS

Data Engineering

Educación

Bachelor's degree in Computer Science or related

Herramientas

Airflow

Kafka/MSK

Databricks Asset Bundles

AWS CDK

CloudFormation

Grafana

Descripción del empleo

Zurich Insurance Group's Technology Delivery Center in Barcelona is seeking a Senior Data Platform Engineer to own and evolve the Databricks platform, ensuring reliability, security, and cost efficiency. You will design and maintain batch and streaming ingestion pipelines, Delta Live Tables, and Delta Lake, plus Unity Catalog governance.

You will build CI/CD pipelines, Databricks Workflows, and collaborate with cloud, data engineering, architecture, and product teams to deliver a scalable