Senior Data Engineer - Spark & Hadoop | Hybrid Krakow

GFT Technologies SE; Polska; Hybrid; PLN 176,000 - 271,000; Full time

Benefits offered by this job

Hybrid work Krakow

Medical benefits

Lunch subsidy

Life insurance

Online training

E-learning access

Social events

Job summary

GFT Technologies SE is seeking a data engineering professional to join a technical team building scalable data solutions in a DevOps environment. You will contribute to design, development, testing and production support in a collaborative Agile setting.

The role emphasizes PySpark/Scala, Hadoop ecosystem, SQL and RESTful services, with hybrid work options in Krakow and a focus on data pipelines and mentoring teammates.

Qualifications

• Experience with PySpark or Scala development and design.
• Experience using scheduling tools such as Airflow.
• Knowledge of Hadoop ecosystem including Spark, Hive, YARN and ETL frameworks.
• Strong SQL and RESTful services knowledge.
• Experience working on Unix or Linux platforms.
• Hands-on experience building data pipelines using Hadoop components.
• Experience with Git, GitHub, Jenkins, Ansible and JIRA.
• Understanding of big data modelling using relational and non-relational techniques.
• Experience debugging code and communicating findings to development teams.

Responsibilities

• Define and contribute to software design and development using PySpark.
• Automate testing of new and existing components.
• Promote development standards through code reviews and mentoring.
• Provide production support and troubleshooting.
• Implement tools and processes ensuring performance, scalability and monitoring.
• Collaborate with Business Analysts to interpret and implement requirements.
• Participate in planning, sprint reviews and retrospectives.
• Contribute to system architecture and design.

Skills

Pyspark

Scala

Airflow

Hadoop ecosystem

Spark

Hive

YARN

ETL frameworks

SQL

RESTful services

Unix/Linux

Data pipelines

Git

GitHub

Jenkins

Ansible

JIRA

Data modelling

Relational & non-relational

Debugging

Java APIs

Python backend services

Tools

Git

GitHub

Jenkins

Ansible

JIRA

Job description

GFT Technologies SE is seeking a data engineering professional to join a technical team building scalable data solutions in a DevOps environment. You will contribute to design, development, testing and production support in a collaborative Agile setting.

The role emphasizes PySpark/Scala, Hadoop ecosystem, SQL and RESTful services, with hybrid work options in Krakow and a focus on data pipelines and mentoring teammates.