Lead Data Engineer

GFT TECHNOLOGIES SE; Kraków; Hybrid; PLN 194,000 - 298,000; Full time

Benefits offered by this job

Hybrid work Kraków 8 days/mo

Medical and sport benefits

Lunch subsidy

Training and certifications

Online learning

Job summary

GFT Technologies SE in Kraków is seeking a senior data engineering lead to provide technical leadership on data migration projects, design scalable pipelines in GCP using PySpark and Scala, and guide cloud architecture.

You will mentor engineers, review code, collaborate with analysts, and help optimize production environments while advancing AI-enabled workflows.

Qualifications

• 10+ years in software design, data engineering and DevOps.
• Strong PySpark or Scala development experience.
• Hands-on with Google Cloud Platform and data pipelines.
• Experience with Spark, Hadoop, Hive, YARN, MapReduce and ETL.
• Proficient in Python, SQL and PL/SQL.
• Experience with Airflow or similar schedulers.
• Experience with REST APIs and Unix/Linux.
• Git, GitHub, Jenkins, Ansible, Jira experience.
• Strong communication and English language skills.

Responsibilities

• Provide technical leadership for data migration projects, including solution design, approach and estimation.
• Design and develop scalable data pipelines using GCP, PySpark and Scala.
• Provide guidance on environment setup, system architecture and cloud design patterns.
• Implement solutions focused on performance, scalability, availability, accuracy and monitoring.
• Promote coding standards, conduct code reviews and support knowledge sharing.
• Mentor engineers and oversee the technical delivery of the engineering pod.
• Work with Business Analysts to ensure requirements are correctly interpreted and implemented.
• Support production environments, troubleshoot issues and communicate findings to development teams.
• Participate in planning sessions, status meetings, sprint reviews and retrospectives.
• Identify opportunities to use AI enablers to improve traditional engineering workflows.

Skills

Leadership

Data migration experience

Mentoring engineers

Excellent English

Tools

PySpark

Scala

GCP

Spark

Hadoop

YARN

Hive

MapReduce

Python

SQL

PL/SQL

Airflow

REST APIs

Unix/Linux

Git

GitHub

Jenkins

Ansible

Jira

ETL frameworks

Job description

Location: Kraków, PL, 30-302

Working place: Hybrid

Working Location:

Type of contract: Employment contract

Salary range: 17400-26700 PLN gross

What will you do?

• Provide technical leadership for data migration projects, including solution design, approach and estimation
• Design and develop scalable data pipelines using GCP, PySpark and Scala
• Provide guidance on environment setup, system architecture and cloud design patterns
• Implement solutions focused on performance, scalability, availability, accuracy and monitoring
• Promote coding standards, conduct code reviews and support knowledge sharing
• Mentor engineers and oversee the technical delivery of the engineering pod
• Work with Business Analysts to ensure requirements are correctly interpreted and implemented
• Support production environments, troubleshoot issues and communicate findings to development teams
• Participate in planning sessions, status meetings, sprint reviews and retrospectives
• Identify opportunities to use AI enablers to improve traditional engineering workflows
• At least 10 years of experience in software design, data engineering and development in Agile and DevOps environments
• Strong development and solution design experience with PySpark or Scala
• Hands‑on experience with Google Cloud Platform and building data pipelines in GCP
• Experience with Apache Spark, Spark SQL, Hadoop, YARN, Hive, MapReduce and ETL frameworks
• Experience with Python, SQL, PL/SQL and data integration
• Experience with Apache Airflow or similar scheduling tools
• Experience with REST APIs and RESTful services
• Strong knowledge of Unix and Linux environments
• Experience with Git, GitHub, Jenkins, Ansible and Jira
• Experience with automated testing, deployment and monitoring
• Understanding of cloud architecture and cloud design patterns
• Ability to lead an engineering pod and guide the work of other engineers
• Ability to work autonomously and act as a technical subject‑matter expert
• Strong communication and presentation skills for technical, senior and non‑technical audiences
• Strong written and spoken English

Nice to have

• Experience with Elasticsearch
• Experience with data ingestion solutions
• Experience working with Scrum and Kanban
• Interest in AI‑based tools that can accelerate engineering workflows

We offer

• Hybrid work in our client's office (Kraków) 8 days a month
• Working in a highly experienced and dedicated team
• Benefit package tailored to your needs (medical, sport, lunch subsidy, life insurance, etc.)
• Online training and certifications
• Access to e‑learning platform
• Social events

We are GFT Poland. WE KNOW how to tackle complex issues with innovative approach to deliver the highest value. Our reputation has been built around one simple rule: we do not overpromise, WE DELIVER. We deliver to our employees, clients and partners. WE GROW as you grow, so investing in you is our business strategy. Caring for each other is our priority. WE CARE who you are, what you need, how you feel. WE CARE to smile, have fun and develop as human beings.

Why Choose GFT?

• A culture of top performance
• Deep tech IT engineering & consulting
• 1200 skilled & top‑class experts
• 77% of the team are regular/senior
• Products that contribute to a sustainable world
• Competitive salary and benefits
• Ambitious projects, trainings and tools you need to flourish
• Google Cloud Partner of the Year - for going above and beyond for customers