GCP Data Engineer: Lakehouse, Airflow & PySpark

Xebia Group; Polska; On-site; PLN 140,000 - 220,000; Full time

Job summary

Xebia Group is seeking a data engineering professional to join our EU-based team, focusing on Lakehouse architectures and data platforms. You will build and optimize data transformation pipelines using dbt, PySpark, and Airflow, while ensuring governance, security, and cost efficiency within BigQuery-driven environments.

Collaborating with cross-functional teams, you will implement IaC with Terraform, CI/CD with GitHub Actions, and leverage Dataplex to manage data assets.

Qualifications

• Hands-on with dbt and Airflow
• Proficient Python and PySpark for data processing
• Experience with BigQuery and data lakehouse design
• Familiarity with medallion architecture concepts
• CI/CD implementation using GitHub Actions
• Infrastructure as Code with Terraform
• Knowledge of IAM, DLP and data governance concepts
• Ability to provide technical consulting and collaborate cross-functionally
• Strong communication and teamwork skills

Responsibilities

• Developing and maintaining Lakehouse Gold and Platinum layers
• Building and optimizing data workflows with dbt and PySpark
• Designing, scheduling, and monitoring data pipelines with Airflow
• Improving BigQuery performance and FinOps optimization
• Managing infrastructure as code with Terraform
• Implementing CI/CD with GitHub Actions
• Supporting cloud security and data governance (IAM, DLP)
• Working with Dataplex for data management and governance
• Collaborating with stakeholders and engineering teams to deliver reliable data solutions

Skills

dbt

Apache Airflow

Python

PySpark

BigQuery

data lakehouse

medallion architecture

CI/CD

Terraform

IAM & DLP

Tools

GitHub Actions

Dataplex

Job description

Xebia Group is seeking a data engineering professional to join our EU-based team, focusing on Lakehouse architectures and data platforms. You will build and optimize data transformation pipelines using dbt, PySpark, and Airflow, while ensuring governance, security, and cost efficiency within BigQuery-driven environments.

Collaborating with cross-functional teams, you will implement IaC with Terraform, CI/CD with GitHub Actions, and leverage Dataplex to manage data assets.