Data Engineer with Iceberg & lakehouse

Abylsen; A distancia; EUR 40.000 - 60.000; Jornada completa

Descripción de la vacante

An international engineering consulting group is seeking a Data Engineer to develop innovative solutions and contribute to diverse projects. The role involves building ETL/ELT pipelines and optimizing data workflows, requiring expertise in AWS Glue, Apache Iceberg, and strong problem-solving skills. Candidates should have 5+ years of experience and be fluent in English. The position offers a permanent contract with remote work options and a competitive salary ranging from 40-60K, along with additional perks like health insurance and training opportunities.

Servicios

Private health insurance

Training and learning platform

Gympass - Wellhub platform

Formación

• 5+ years of experience with AWS data services.
• Strong expertise in AWS Glue and Apache Iceberg.
• Proficiency in Java (Python or Scala is a plus).

Responsabilidades

• Define project scope and goals in collaboration with stakeholders.
• Design and implement ETL/ELT pipelines for network telemetry data.
• Optimize data processing workflows for advanced analytics.

Conocimientos

AWS Glue

Apache Iceberg

Lakehouse architectures

Fluent English

Java

Spark

SQL expertise

Problem-solving abilities

Herramientas

AWS data services

Modern data processing tools

Descripción del empleo

L'offre

ABYLSENis an international engineering consulting group with4300 employees. Created by a number of entrepreneurs in 2005, the group was born from a common development ambitions across the major European regions and is now located in42 locationsspread over8 countries (France, Switzerland, Luxembourg, Belgium, the Netherlands, Italy, Spain and UK).

Our main goal is to meet the needs of our clients across different sectors and key locations in the local market by supporting them with their projects and challenges through the expertise of our teams.

We are looking fora Data Engineer with experience in Iceberg & lakehouse architecturewho can create innovative solutions, continuously develop their team's performance, and contribute to diverse and enriching projects on a daily basis!

💻 ¿What would you be doing in your day a day?

you will work within a multidisciplinary and international team to develop a Proof of Concept (PoC) focused on advanced data processing, network telemetry, and lakehouse architectures. We are looking for a Data Engineer with strong innovation mindset, hands-on problem-solving skills, and the ability to work in a highly collaborative environment.

• Define project scope, goals, and deliverables in collaboration with stakeholders.
• Define and design the software architecture from scratch, ensuring scalability, reliability, and security .
• Design and implement ETL/ELT pipelines for large-scale network telemetry data
• Interface with on-premises data collection systems and ensure seamless data ingestion
• Build and optimize Apache Iceberg table structures, including time-series datasets
• Optimize data processing workflows for advanced analytics and AI use cases
• Implement data quality controls, lineage tracking, and observability across pipelines
• Ensure modern data protection and governance practices are applied throughout the data lifecycle

🤔 What about our recruiting process?

• A 10-15 minutes call with our Talent Acquisition
• A videocall with our Talent Acquisition to explain who we are and how we work
• A videocall or a personal meeting with our Business Managers to know more about the technical part & the project
• A meeting with the client

🚀 And, last but not least, what do we offer?

• 🔛 Permanent contract with Abylsen as our consultant
• ⏰Remote position with occasional travels to Europe (1 every 2 months approx.)
• 💸 Salary base 40-60K (open to negotiate depending on candidate's experience)
• 🩺 Private health insurance covered by Abylsen
• 🎯 A big training & learning platform with a lot of free courses (languages, software, soft skills…)
• 💪 Gympass - Wellhub platform with lots of well-being and sports centers & activities (crossfit, yoga…)

✨ What do we need from you? ✨

Here are the key qualifications and skills required:

• Strong expertise with AWS Glue , Apache Iceberg , and lakehouse architectures
• Fluent English (spoken and written)
• 5+ years of experience with AWS data services (Glue, S3, Athena, IAM, Lake Formation, Lambda, S3 Tables)
• Proficiency in Java (Python or Scala also valued) for data processing
• Experience with time-series data and associated query patterns
• Knowledge of modern data processing tools: Spark, DuckDB, Flink, Airflow, Prefect
• Strong SQL expertise
• Strong problem-solving abilities, especially with data-quality and integration challenges
• Ability to collaborate effectively with cross-functional and international teams

No barrier should hold back talent ! Dedicated to equal opportunities, our Group embraces an inclusive approach: every position is open to all, and we actively support the integration of people with disabilities.