Data Engineer - Java & Scala (f/m/x)

Sii Polska; Warszawa; Hybride; PLN 180 000 - 240 000; Plein temps

Avantages offerts par ce poste

Hybrid work model

Résumé du poste

Sii Polska in Warsaw is seeking a Data Engineer to help modernize our backend data processing platform on a Big Data stack within an internal cloud. The role offers a hybrid work model with 2-3 days in the office each week.

You will design and maintain scalable data pipelines using Scala and Apache Spark, implement ETL/ELT processes, and develop Java-based data processing components. Collaboration with cross-functional teams is essential.

Qualifications

• Minimum 4 years of experience as a Data Engineer on large-scale data projects.
• Strong knowledge of Scala and Apache Spark.
• Hands-on Java development for backend data processing.
• Experience designing ETL/ELT data pipelines.
• Good SQL skills and relational databases expertise.
• Experience with distributed systems and Big Data environments.
• Proficiency in Polish and English; residency in Poland.

Responsabilités

• Design, develop, and maintain scalable data pipelines with Scala and Spark.
• Implement ETL/ELT processes and transformations for large data volumes.
• Develop and maintain data processing components using Java.
• Optimize performance of Spark applications and workflows.
• Integrate data from diverse sources for banking systems usage.
• Collaborate with Data Engineers, Developers, Analysts and business teams.

Connaissances

Scala

Apache Spark

Java

ETL/ELT

SQL

Distributed systems

Big Data

Polish language

English language

Description du poste

O projekcie:

We are looking for a skilled Data Engineer to join our team in Warsaw, working on a project focused on modernizing the backend data processing platform for an investment bank. This role involves collaborating with feature teams to enhance data processing capabilities using Big Data technology on an internal cloud. You will be part of a modern, data-driven environment, with a hybrid work model that includes 2-3 days in the office each week. If you are passionate about backend development and data engineering, this opportunity may be the right fit for you.

Wymagania:

• - Minimum 4 years of experience as a Data Engineer working on projects involving large-scale data processing
• - Strong knowledge of Scala and Apache Spark
• - Practical experience with Java and developing backend applications or data processing solutions
• - Experience designing and implementing ETL/ELT processes and data pipelines
• - Good knowledge of SQL and relational databases
• - Experience working with distributed systems and Big Data environments
• - Advanced knowledge of both Polish and English, and residency in Poland

Codzienne zadania:

• - Designing, developing, and maintaining scalable data pipelines using Scala and Apache Spark
• - Implementing ETL/ELT processes and transformations for large volumes of data
• - Developing and maintaining data processing components using Java
• - Optimizing the performance of Spark applications and data processing workflows
• - Integrating data from various sources and preparing it for further analysis and use by banking systems
• - Collaborating with Data Engineers, Developers, Analysts, and business teams to design and deliver data solutions
• - Monitoring code quality and conducting continuous integration