Senior Data Platform Engineer - Lakehouse & Data Catalog

Sabia Personal; España; Híbrido; EUR 75.000 - 110.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Indefinite contract

Hybrid work in San Sebastian offices

Private health insurance

Educational budget support

Descripción de la vacante

Sabia Personal is seeking a Senior Data Engineer to own end-to-end data platform architectures, including lakehouse, catalogs, and governance. You will design and operate large-scale ETL/ELT pipelines and collaborate with ML/AI teams to make data products consumable by analytics and APIs.

You will partner with clients to scope requirements, mentor engineers, and drive best practices while staying current with open table formats, orchestration, and data governance trends.

Formación

• Bachelor's or master's degree in computer science, software engineering, or related field
• 4+ years of professional data engineering experience with production data platforms or pipelines
• Expert in Python and SQL
• Data modeling, ETL development, and database management (SQL and NoSQL)
• Experience with lakehouse architectures and columnar formats (Parquet, Iceberg, Delta Lake)
• Experience with Spark and workflow orchestrators (Airflow or Argo)
• Strong cloud experience (Azure, AWS, GCP) including object storage, containers, and Kubernetes
• Solid data governance knowledge: catalogs, metadata, lineage, access control, dataset versioning
• Git-based workflows, CI/CD, and IaC practices
• Excellent problem-solving and communication; ability to lead client discussions in English

Responsabilidades

• Own end-to-end data platform architectures (lakehouse, catalogs, governance) from scoping to production release
• Design, implement, and operate large-scale ETL/ELT pipelines and workflows
• Define data modeling, partitioning, schema evolution, and versioning conventions
• Establish and maintain data catalogs, schemas, metadata, lineage, and access policies
• Validate datasets against sources for completeness and performance with objective criteria
• Collaborate with ML/AI engineers to make data products consumable by analytics and APIs
• Work with clients to scope requirements, lead technical sessions, and document architectures
• Mentor data engineers, review designs and code, raise engineering standards
• Keep up with trends in data engineering and adopt where valuable

Conocimientos

Python

SQL

Data modeling

ETL development

Lakehouse

Spark

Airflow

Argo Workflows

Cloud platforms

Git & CI/CD

Educación

Bachelor's or Master's in CS/SE

Herramientas

Parquet

Apache Iceberg

Delta Lake

Spark

Airflow

Argo Workflows

Kubernetes

Azure/AWS/GCP

Descripción del empleo

Sabia Personal is seeking a Senior Data Engineer to own end-to-end data platform architectures, including lakehouse, catalogs, and governance. You will design and operate large-scale ETL/ELT pipelines and collaborate with ML/AI teams to make data products consumable by analytics and APIs.

You will partner with clients to scope requirements, mentor engineers, and drive best practices while staying current with open table formats, orchestration, and data governance trends.