Senior Data Engineer with GCP

Link Group; Województwo mazowieckie; Presencial; PLN 180.000 - 240.000; Jornada completa

Descripción de la vacante

Link Group is seeking a Senior Data Engineer to lead the migration of on-premise data platforms to Google Cloud Platform. You will design scalable data pipelines, optimize processing with Spark, PySpark and Airflow, and collaborate with engineers, architects, and business stakeholders to ensure a smooth transition.

You will analyze current workflows, propose cloud-native solutions, and translate business requirements into technical designs while communicating progress and risks clearly.

Formación

• Experience with Google Cloud Platform (GCP) including BigQuery, Dataproc, IAM and GCS.
• Terraform & Infrastructure as Code experience.
• Strong Spark / PySpark (3.5) and Airflow (3.x).
• Good SQL skills and data transformation expertise.
• Familiarity with Git, CI/CD and GitHub Actions.
• Ability to translate business requirements into technical solutions.

Responsabilidades

• Design and implement data pipeline migration from on-premise environments to GCP.
• Analyze existing workflows and recommend improvements and cloud-native solutions.
• Collaborate with engineers and architects on technical design and implementation.
• Develop and optimize data processing solutions using Spark, PySpark, and Airflow.
• Estimate workloads and report delivery progress and potential risks.
• Work with business stakeholders to clarify requirements and recommend suitable technical solutions.

Conocimientos

Fluent English

Analytical thinking

Communication skills

Translate business requirements

Proactive, collaborative

Herramientas

BigQuery

IAM

Dataproc

GCS

Terraform

Apache Spark

PySpark

Airflow

Git

CI/CD

GitHub Actions

SQL

Descripción del empleo

Senior Data Engineer – Cloud Migration

Role Overview We are looking for an experienced Data Engineer to support a data platform modernization project involving the migration of existing on-premise solutions to Google Cloud Platform. The role includes designing and optimizing data pipelines, defining technical solutions, and collaborating with engineers, architects, and business stakeholders to ensure a smooth migration.

Responsibilities

• Design and implement data pipeline migration from on-premise environments to GCP.
• Analyze existing workflows and recommend improvements and cloud-native solutions.
• Collaborate with engineers and architects on technical design and implementation.
• Develop and optimize data processing solutions using Spark, PySpark, and Airflow.
• Estimate workloads and report delivery progress and potential risks.
• Work with business stakeholders to clarify requirements and recommend suitable technical solutions.

Requirements

• Hands-on experience with GCP, particularly BigQuery, IAM, Dataproc, and GCS.
• Knowledge of Terraform and Infrastructure as Code.
• Strong experience with Apache Spark and PySpark (3.5).
• Experience with Apache Airflow (3.x).
• Good SQL skills and experience with data transformation.
• Familiarity with Git, CI/CD, and GitHub Actions.
• Ability to translate business requirements into technical solutions.
• Strong analytical and communication skills.
• Proactive, collaborative approach and fluent English.

Nice to Have

• Experience with Scala or Java.
• Familiarity with BI and data visualization tools.
• Previous experience in banking or financial services.