Senior Data Engineer: Data Lake Modernization & Iceberg

ERNI - Swiss Software Engineering; Madrid; Híbrido; EUR 60.000 - 90.000; Jornada completa

Descripción de la vacante

ERNI – Swiss Software Engineering is seeking a senior Data Engineer to accelerate a cloud-native Data Lake modernization project. You will apply your knowledge of AWS, Apache Iceberg, Python, DuckDB and SQL to enhance scalability, governance, and performance across the platform.

As a senior member, you will mentor peers and contribute to onboarding, with a hybrid work model featuring regular office days. 4–6+ years of data engineering experience is preferred.

Formación

• 4 to 6+ years of experience in Data Engineering and cloud-native data platforms.
• Hands-on experience with AWS services such as S3, Athena, Redshift and Lambda.
• Experience working with Apache Iceberg, Delta Lake or Hudi and strong knowledge of data modeling, partitioning and schema evolution.
• Proficiency in Python, SQL, DuckDB or similar transformation technologies and Docker.
• Experience with Git and performance optimization of analytical workloads.

Responsabilidades

• Accelerate the migration of datasets and pipelines to an Apache Iceberg architecture.
• Develop Python-based data processing jobs and SQL transformations with DuckDB.
• Optimize performance and cost efficiency, manage Redshift data structures and views.
• Participate in testing and code reviews, ensure proper documentation and knowledge transfer across the project.

Conocimientos

Data engineering

AWS

Apache Iceberg

Python

SQL

DuckDB

Docker

Git

Performance optimization

Herramientas

DuckDB

Docker

Redshift

Descripción del empleo

ERNI – Swiss Software Engineering is seeking a senior Data Engineer to accelerate a cloud-native Data Lake modernization project. You will apply your knowledge of AWS, Apache Iceberg, Python, DuckDB and SQL to enhance scalability, governance, and performance across the platform.

As a senior member, you will mentor peers and contribute to onboarding, with a hybrid work model featuring regular office days. 4–6+ years of data engineering experience is preferred.