Senior Data Engineering Lead - GCP, Spark & Pipelines

GFT Poland; Kraków; Hybrid; PLN 300,000 - 460,000; Full time

Benefits offered by this job

Competitive salary

Hybrid work model

Training opportunities

Job summary

GFT Poland seeks a seasoned Data Engineering/Delivery Lead to steer data migration and engineering initiatives within a hybrid setup in Kraków. You will design scalable data pipelines in Google Cloud, guide an engineering pod, and promote best practices across the team.

You will apply PySpark/Scala expertise, Spark ecosystem knowledge, and REST API experience to deliver high-value solutions while aligning with Agile processes and DevOps principles.

Qualifications

• 10+ years of experience in software design, data engineering and development in Agile/DevOps
• Strong experience with PySpark or Scala and data pipelines on GCP
• Hands-on with GCP data pipelines and Spark ecosystem
• Experience with REST APIs, Unix/Linux, and CI/CD tooling

Responsibilities

• Provide technical leadership for data migration projects
• Design and develop scalable data pipelines using GCP, PySpark and Scala
• Guide the engineering pod and promote coding standards
• Mentor engineers and oversee delivery across sprints
• Collaborate with Analysts to ensure requirements are implemented

Skills

Leadership

English communication

Agile/DevOps

Data migration

Solution design

Autonomy

Presentation skills

Tools

PySpark

Scala

Google Cloud Platform

Apache Spark

Hadoop/YARN/Hive

Airflow

SQL/PLSQL

Git/Jenkins/Jira

Job description

GFT Poland seeks a seasoned Data Engineering/Delivery Lead to steer data migration and engineering initiatives within a hybrid setup in Kraków. You will design scalable data pipelines in Google Cloud, guide an engineering pod, and promote best practices across the team.

You will apply PySpark/Scala expertise, Spark ecosystem knowledge, and REST API experience to deliver high-value solutions while aligning with Agile processes and DevOps principles.