Expert Java/Scala Engineer with Spark

GFT Technologies Poland; Kraków; Hybrid; PLN 120,000 - 180,000; Full time

Benefits offered by this job

Hybrid work Kraków

Benefits package

Job summary

GFT Technologies Poland seeks a data engineer to join a global agile team building and enhancing data processing and storage solutions for risk management and surveillance capabilities.

You will collaborate with Product Owners, Analysts, Architects, Data Scientists and Engineers to develop scalable big data solutions, onboard new data sources, and deliver strategic initiatives within a highly regulated financial environment.

Qualifications

• Experience with Spark and big data technologies in a production environment.

Responsibilities

• Work with Product Owners and IT Analysts to understand business and stakeholder requirements

Skills

Java/Scala programming

Big data processing

ETL development

CI/CD & TDD

English communication

Tools

Apache Spark

Hadoop

Spring Framework

Airflow

SQL databases

Elasticsearch

Python

GCP

Maven

Git

Job description

You will join a global agile team responsible for building and enhancing data processing and storage solutions that support risk management and surveillance capabilities. Working closely with Product Owners, Analysts, Architects, Data Scientists, and Engineers, you will contribute to the development of scalable big data solutions and help deliver key strategic initiatives within a highly regulated financial environment.

• Work with Product Owners and IT Analysts to understand business and stakeholder requirements
• Build and manage data processing components and storage technologies
• Onboard new data sources and develop data processing pipelines
• Prepare and deliver data views required by application development teams
• Collaborate with Data Scientists to productionise analytics solutions
• Develop software in line with continuous integration and test-driven development principles
• Validate technical designs and ensure adherence to architectural standards
• Perform unit testing and maintain high code quality standards
• Practical experience with Apache Spark
• Strong programming experience using Java and/or Scala
• Experience building and maintaining ETL solutions
• Experience working with big data processing technologies
• Strong communication skills in English

Nice to have

• Experience with Apache Hadoop (YARN, HDFS)
• Experience with Spring Framework
• Knowledge of Apache Airflow
• Experience with SQL databases
• Experience with Elasticsearch
• Experience with Python
• Experience deploying services on Google Cloud Platform
• Knowledge of Maven
• Knowledge of Git
• Experience working in Agile environments

We offer

• Hybrid work in our client's office (Kraków) 8 days a month
• Working in a highly experienced and dedicated team
• Benefit package tailored to your needs (medical, sport, lunch subsidy, life insurance, etc.)