Lead Data Engineer

GFT Technologies Poland; Kraków; Hybrid; PLN 200,000 - 320,000; Full time

Benefits offered by this job

Hybrid work in Kraków office

Medical & life insurance

Sport subsidy

Lunch subsidy

Job summary

GFT Technologies Poland in Kraków seeks a seasoned engineering leader to drive data migration and data engineering initiatives. You will design scalable data pipelines in GCP, mentor the engineering pod and promote development standards.

You will partner with Engineers, Data Analysts and Business Analysts to ensure requirements are translated into robust solutions, support production environments and contribute to agile ceremonies. Strong English and collaboration skills are required.

Qualifications

• 10+ years in software design, data engineering and development in Agile/DevOps.
• Hands-on experience with PySpark or Scala and data pipelines in GCP.

Responsibilities

• Provide technical leadership for data migration projects, including design and estimation.
• Design and develop scalable data pipelines using GCP, PySpark and Scala.
• Mentor engineers and oversee the technical delivery of the engineering pod.
• Promote coding standards, conduct code reviews and support knowledge sharing.
• Collaborate with Analysts to translate requirements into robust solutions.
• Support production environments, troubleshoot issues and communicate findings.
• Participate in planning, sprint reviews and retrospectives.
• Explore AI-enabled approaches to improve engineering workflows.

Skills

Technical leadership

Data migration

GCP expertise

PySpark

Scala

Python

SQL

REST APIs

Unix/Linux

Git/Jenkins/Jira

Agile/DevOps

Mentoring

Communication

Tools

Apache Spark

Hadoop

Airflow

Spark SQL

ETL frameworks

Job description

You will lead the technical delivery of data migration and engineering initiatives, working closely with Engineers, Data Analysts and Business Analysts. You will design scalable data solutions in GCP, guide the engineering pod, promote development standards and support the team throughout the Agile development process.

• Provide technical leadership for data migration projects, including solution design, approach and estimation
• Design and develop scalable data pipelines using GCP, PySpark and Scala
• Provide guidance on environment setup, system architecture and cloud design patterns
• Implement solutions focused on performance, scalability, availability, accuracy and monitoring
• Promote coding standards, conduct code reviews and support knowledge sharing
• Mentor engineers and oversee the technical delivery of the engineering pod
• Work with Business Analysts to ensure requirements are correctly interpreted and implemented
• Support production environments, troubleshoot issues and communicate findings to development teams
• Participate in planning sessions, status meetings, sprint reviews and retrospectives
• Identify opportunities to use AI enablers to improve traditional engineering workflows
• At least 10 years of experience in software design, data engineering and development in Agile and DevOps environments
• Strong development and solution design experience with PySpark or Scala
• Hands‑on experience with Google Cloud Platform and building data pipelines in GCP
• Experience with Apache Spark, Spark SQL, Hadoop, YARN, Hive, MapReduce and ETL frameworks
• Experience with Python, SQL, PL/SQL and data integration
• Experience with Apache Airflow or similar scheduling tools
• Experience with REST APIs and RESTful services
• Strong knowledge of Unix and Linux environments
• Experience with Git, GitHub, Jenkins, Ansible and Jira
• Experience with automated testing, deployment and monitoring
• Understanding of cloud architecture and cloud design patterns
• Ability to lead an engineering pod and guide the work of other engineers
• Ability to work autonomously and act as a technical subject‑matter expert
• Strong communication and presentation skills for technical, senior and non‑technical audiences
• Strong written and spoken English

Nice to have

• Experience with Elasticsearch
• Experience with data ingestion solutions
• Experience working with Scrum and Kanban
• Interest in AI‑based tools that can accelerate engineering workflows

We offer

• Hybrid work in our client's office (Kraków) 8 days a month
• Working in a highly experienced and dedicated team
• Benefit package tailored to your needs (medical, sport, lunch subsidy, life insurance, etc.)