Senior Data Engineering Lead: Cloud Pipelines & AI

GFT Technologies SE; Kraków; Hybrid; PLN 194,000 - 298,000; Full time

Benefits offered by this job

Hybrid work in Kraków office

Medical, sport, lunch subsidy, life保险

Online training and certifications

Access to e-learning platform

Social events

Job summary

GFT Technologies SE in Kraków is seeking an experienced data engineering leader to drive data migration and engineering initiatives. You will design scalable data pipelines in GCP, guide the pod, promote standards, and support agile delivery.

We require 10+ years in software/data engineering, strong PySpark/Scala skills, GCP expertise, and leadership abilities to mentor engineers and ensure high-quality solutions. Hybrid office-based role with the client in Kraków.

Qualifications

• At least 10 years of experience in software design, data engineering and development in Agile and DevOps environments.
• Strong development and solution design experience with PySpark or Scala.
• Hands-on experience with Google Cloud Platform and building data pipelines in GCP.
• Experience with Apache Spark, Spark SQL, Hadoop, YARN, Hive, MapReduce and ETL frameworks.
• Experience with Python, SQL, PL/SQL and data integration.
• Experience with Apache Airflow or similar scheduling tools.
• Experience with REST APIs and RESTful services.
• Strong knowledge of Unix and Linux environments.
• Experience with Git, GitHub, Jenkins, Ansible and Jira.
• Experience with automated testing, deployment and monitoring.
• Understanding of cloud architecture and cloud design patterns.
• Ability to lead an engineering pod and guide the work of other engineers.
• Ability to work autonomously and act as a technical subject-matter expert.
• Strong communication and presentation skills for technical, senior and non-technical audiences.
• Strong written and spoken English.

Responsibilities

• Lead the technical delivery of data migration and engineering initiatives.
• Design scalable data solutions in GCP and guide the engineering pod.
• Promote development standards and support the team in Agile processes.
• Mentor engineers and oversee technical delivery of the pod.
• Collaborate with Business Analysts to interpret requirements.
• Support production environments and troubleshoot issues.
• Participate in planning, stand-ups, sprint reviews and retrospectives.
• Identify opportunities to use AI enablers to improve workflows.

Skills

Data engineering

PySpark

Scala

GCP

Spark

Python

SQL

REST APIs

Unix/Linux

Git

Jenkins

Airflow

Jira

Agile

Tools

Jira

GitHub

Jenkins

Ansible

Airflow

Elasticsearch

Job description

GFT Technologies SE in Kraków is seeking an experienced data engineering leader to drive data migration and engineering initiatives. You will design scalable data pipelines in GCP, guide the pod, promote standards, and support agile delivery.

We require 10+ years in software/data engineering, strong PySpark/Scala skills, GCP expertise, and leadership abilities to mentor engineers and ensure high-quality solutions. Hybrid office-based role with the client in Kraków.