Senior Data Engineer - GCP Cloud Migration & Pipelines

Link Group; Województwo mazowieckie; Vor Ort; PLN 180.000 - 240.000; Vollzeit

Zusammenfassung

Link Group is seeking a Senior Data Engineer to lead the migration of on-premise data platforms to Google Cloud Platform. You will design scalable data pipelines, optimize processing with Spark, PySpark and Airflow, and collaborate with engineers, architects, and business stakeholders to ensure a smooth transition.

You will analyze current workflows, propose cloud-native solutions, and translate business requirements into technical designs while communicating progress and risks clearly.

Qualifikationen

• Experience with Google Cloud Platform (GCP) including BigQuery, Dataproc, IAM and GCS.
• Terraform & Infrastructure as Code experience.
• Strong Spark / PySpark (3.5) and Airflow (3.x).
• Good SQL skills and data transformation expertise.
• Familiarity with Git, CI/CD and GitHub Actions.
• Ability to translate business requirements into technical solutions.

Aufgaben

• Design and implement data pipeline migration from on-premise environments to GCP.
• Analyze existing workflows and recommend improvements and cloud-native solutions.
• Collaborate with engineers and architects on technical design and implementation.
• Develop and optimize data processing solutions using Spark, PySpark, and Airflow.
• Estimate workloads and report delivery progress and potential risks.
• Work with business stakeholders to clarify requirements and recommend suitable technical solutions.

Kenntnisse

Fluent English

Analytical thinking

Communication skills

Translate business requirements

Proactive, collaborative

Tools

BigQuery

IAM

Dataproc

GCS

Terraform

Apache Spark

PySpark

Airflow

Git

CI/CD

GitHub Actions

SQL

Jobbeschreibung

Link Group is seeking a Senior Data Engineer to lead the migration of on-premise data platforms to Google Cloud Platform. You will design scalable data pipelines, optimize processing with Spark, PySpark and Airflow, and collaborate with engineers, architects, and business stakeholders to ensure a smooth transition.

You will analyze current workflows, propose cloud-native solutions, and translate business requirements into technical designs while communicating progress and risks clearly.