GCP Data Platform Engineer (EU) – Spark, Airflow

Xebia Group; Polska; Hybrid; PLN 180,000 - 240,000; Full time

Job summary

Xebia Group is seeking a Data Platform Engineer to design, build and optimize data pipelines on Google Cloud Platform. You will implement ETL/ELT processes using Dataproc, Spark, and Airflow to deliver scalable, cost-efficient data platforms for clients in the EU.

You will collaborate with platform, analytics, and DevOps teams on architecture, reliability, and observability, while ensuring best practices for data governance and performance. EU work rights required.

Qualifications

• Extensive experience building and operating data platforms on Google Cloud Platform.
• Hands-on with Dataproc and Apache Spark.
• Experience designing and developing ETL/ELT pipelines.
• Experience with BigQuery and Google Cloud Storage.
• Strong SQL and Python skills.
• Experience optimizing cloud costs.
• Experience designing ingestion frameworks and reusable data-processing components.
• Understanding of data-platform architecture patterns, including Bronze/Silver/Gold layers.
• Experience troubleshooting and supporting production data pipelines.
• Strong hands-on experience with Apache Airflow.
• Experience designing, implementing, and maintaining complex DAGs.
• Work from the European Union region and a work permit are required

Responsibilities

• Design, develop, and optimize ETL/ELT pipelines on GCP.
• Optimize Spark workloads on Dataproc and Dataproc Serverless.
• Implement workload-routing strategies and cost-optimization mechanisms.
• Design and maintain data-ingestion processes for Bronze, Silver, and Gold layers.
• Organizing and managing raw-data structures in Google Cloud Storage.
• Designing and implementing event-driven orchestration using Pub/Sub and Apache Airflow.
• Developing, maintaining, and optimizing Airflow DAGs and orchestration frameworks.
• Implementing data reprocessing and backfill capabilities.
• Consolidating related processing workflows into reusable orchestration patterns.
• Extending and improving metadata-driven generators and platform tooling.
• Supporting artifact generation, regeneration, and distribution processes.
• Improving observability, reliability, and operational support for data pipelines.
• Collaborating with platform, analytics, and DevOps teams on architecture and implementation decisions.

Skills

GCP data platform experience

SQL

Python

Cost optimization

Data pipeline design

Tools

Dataproc

Apache Spark

Airflow

BigQuery

Google Cloud Storage

Pub/Sub

Job description

Xebia Group is seeking a Data Platform Engineer to design, build and optimize data pipelines on Google Cloud Platform. You will implement ETL/ELT processes using Dataproc, Spark, and Airflow to deliver scalable, cost-efficient data platforms for clients in the EU.

You will collaborate with platform, analytics, and DevOps teams on architecture, reliability, and observability, while ensuring best practices for data governance and performance. EU work rights required.