Senior Data Engineer

Xebiacee

Poland

Remote

PLN 210,000 - 270,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Xebia is seeking a senior Data Engineer to lead architecture for user-data handling across Airflow, Spark, dbt and BigQuery, and to migrate pipelines while preserving outputs.

The role includes building regression tests, defining post-migration processes, mentoring a teammate, and documenting architecture decisions. EU region work and a valid EU work permit are required.

Qualifications

  • Deep hands-on experience with Airflow, Spark, dbt, BigQuery and Python.
  • A track record of technically leading at least one pipeline migration from start to finish.
  • Experience refactoring a live pipeline and proving that its output remained unchanged.
  • Proven ability to introduce engineering practices such as testing, code review and incident handling, and help a team adopt them consistently.
  • Mentoring experience with a concrete outcome.

Responsibilities

  • Proposing and driving the architecture for user-data handling across Airflow, Spark, dbt and BigQuery, including encryption points, derived tables, backfills and partitioning.
  • Migrating existing pipelines one at a time while keeping their outputs unchanged, using a regression harness you build.
  • Designing and introducing processes the team will use after the migration, including pipeline change reviews, testing standards, incident post-mortems and release checklists.
  • Refactoring pipelines to remove duplicated steps and copy-pasted logic.
  • Building verification jobs to demonstrate that data-lifecycle rules are followed end to end.
  • Pairing with and mentoring a data engineer, with the goal of enabling the team to own the migrated pipelines independently.
  • Sharing pipeline maintenance and incident handling, and addressing root causes.
  • Documenting key decisions in concise architecture decision records.

Skills

Airflow
Spark
dbt
BigQuery
Python
Mentoring

Tools

Config Connector (KCC)
Kafka

Job description

Xebia is a global AI-first, digital transformation, and engineering partner. With over 25 years of experience and a team of 5,000 professionals across 16 countries, we help organizations design and build scalable products, platforms, and data-driven solutions. We specialize in Artificial Intelligence, Data and Cloud, Intelligent Automation, and Digital Products, combining deep technical expertise with a strong focus on engineering excellence and a people-first culture. In the CEE region, we’re a team of nearly 1,000 experts delivering modern applications, data platforms, and AI solutions for clients such as Millennium, ING, Play, Edenred, Arabian Drilling, FedEx, Leroy Merlin, Truecaller, Volotea, Schmitz Cargobull, and many, many more. We work with leading technologies including AWS, Azure, GCP, Databricks, and Snowflake, and combine strong engineering culture with a consulting mindset and a continuous focus on growth and knowledge sharing.

You will be:
  • Proposing and driving the architecture for user-data handling across Airflow, Spark, dbt and BigQuery, including encryption points, derived tables, backfills and partitioning.
  • Migrating existing pipelines one at a time while keeping their outputs unchanged, using a regression harness you build.
  • Designing and introducing processes the team will use after the migration, including pipeline change reviews, testing standards, incident post-mortems and release checklists.
  • Refactoring pipelines to remove duplicated steps and copy-pasted logic.
  • Building verification jobs to demonstrate that data-lifecycle rules are followed end to end.
  • Pairing with and mentoring a data engineer, with the goal of enabling the team to own the migrated pipelines independently.
  • Sharing pipeline maintenance and incident handling, and addressing root causes.
  • Documenting key decisions in concise architecture decision records.
  • Work from the European Union region and a work permit are required.
Your profile:
  • Deep hands-on experience with Airflow, Spark, dbt, BigQuery and Python.
  • A track record of technically leading at least one pipeline migration from start to finish.
  • Experience refactoring a live pipeline and proving that its output remained unchanged.
  • Proven ability to introduce engineering practices such as testing, code review and incident handling, and help a team adopt them consistently.
  • Mentoring experience with a concrete outcome.
  • A hands-on approach to technical decisions, combined with the ability to support and guide other engineers.
  • Nice to have: Experience with encryption at rest, data retention or deletion compliance, for example GDPR.
  • Nice to have: Experience with envelope encryption and a key manager such as GCP KMS, BigQuery AEAD functions or Tink.
  • Nice to have: Experience with BigQuery column-level security, policy tags or Data Catalog.
  • Nice to have: Experience with Config Connector (KCC) for managing GCP resources from Kubernetes.
  • Nice to have: Experience working with Kafka events.
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Data Engineer
Senior Data Engineer

Poland and Central-Eastern Europe • Poland

Remote
PLN 200,000 - 260,000
Senior Data Engineer
Senior Data Engineer

Softeta • Kraków

Hybrid
PLN 180,000 - 260,000
Hybrid workplace model
Flexible working hours
Training budget for growth
+1
GCP Data Engineer
GCP Data Engineer

Xebiacee • Polska

Remote
PLN 306,000 - 437,000
Senior Data Engineer: Pipeline Migrations & Data Platforms
Senior Data Engineer: Pipeline Migrations & Data Platforms

Poland and Central-Eastern Europe • Poland

Remote
PLN 200,000 - 260,000
Senior Azure Data Engineer
Senior Azure Data Engineer

Xebia • Polska

On-site
PLN 250,000 - 360,000
Data AI Architect
Data AI Architect

Xebiacee • Poland

On-site
PLN 180,000 - 360,000
GCP Data Engineer
GCP Data Engineer

Poland and Central-Eastern Europe • Polska

Remote
PLN 262,000 - 393,000
Senior Data Engineer
Senior Data Engineer

Diverse Consulting Group • Gdańsk

On-site
PLN 180,000 - 260,000
Private medical care
Co-financing for the sports card
Dedicated consultant support
Data AI Architect
Data AI Architect

Poland and Central-Eastern Europe • Polska

On-site
PLN 180,000 - 280,000
Senior GCP Data Engineer
Senior GCP Data Engineer

Xebiacee • Polska

On-site
PLN 190,000 - 270,000
Top locations