Spark Software Engineer

Antal Sp. z o.o.; Kraków; Hybrid; PLN 250,000 - 380,000; Full time

Benefits offered by this job

private healthcare (LuxMed)

sports package (Multisport)

Job summary

Antal Sp. z o.o. in Kraków is seeking a data engineer to join a global risk & compliance team within a leading international bank.

You will design and maintain modern data platforms and big data solutions that support large-scale surveillance and risk management, collaborating with engineers, data scientists and analysts worldwide. The role is hybrid (6 days per month in the office) with a focus on CI/CD, TDD and high-quality code.

Qualifications

• Strong commercial experience with Apache Spark.
• Solid programming experience in Java or Scala.
• Experience building large-scale data processing solutions.
• Understanding of software engineering best practices and Agile methodologies.
• English proficiency at B2 level or higher.

Responsibilities

• Collaborate with Product Owners and Business Analysts to understand business and stakeholder requirements
• Design, develop, and maintain data processing components and storage solutions
• Onboard new data sources and build scalable ETL/data processing pipelines
• Work closely with Data Scientists to productionize analytical models and solutions
• Develop software following CI/CD and Test-Driven Development (TDD) practices
• Partner with Solution Architects to validate and implement technical designs
• Perform unit testing and ensure high code quality standards
• Contribute to the continuous improvement of development processes and engineering practices

Skills

Apache Spark

Java/Scala

Large-scale data processing

Agile methodologies

English B2+

Communication

Tools

Apache Hadoop

Spring Framework

Apache Airflow

SQL

Elasticsearch

Maven

Git

Job description

Location: Kraków, Poland

Work mode: hybrid, 6 days per month from the office

About the Project:

Join a global technology team within the Risk & Compliance domain of a leading international banking organization. The team develops cutting-edge solutions that help protect customers and the business from financial crime, market abuse, identity threats, regulatory risks, and other compliance-related challenges.

You will become part of a global Agile team responsible for building modern data platforms and big data solutions that support large-scale surveillance and risk management initiatives. This role offers the opportunity to work on highly impactful systems, collaborating with engineers, architects, analysts, and data scientists from around the world.

Your Responsibilities:

• Collaborate with Product Owners and Business Analysts to understand business and stakeholder requirements
• Design, develop, and maintain data processing components and storage solutions
• Onboard new data sources and build scalable ETL/data processing pipelines
• Work closely with Data Scientists to productionize analytical models and solutions
• Develop software following CI/CD and Test-Driven Development (TDD) practices
• Partner with Solution Architects to validate and implement technical designs
• Perform unit testing and ensure high code quality standards
• Contribute to the continuous improvement of development processes and engineering practices

Requirements:

Must Have:

• Strong commercial experience with Apache Spark
• Solid programming experience in Java or Scala
• Experience building large-scale data processing solutions
• Understanding of software engineering best practices and Agile methodologies
• Strong communication skills and ability to work effectively in an international team
• English proficiency at B2 level or higher

Nice to Have:

• Experience with Apache Hadoop (YARN, HDFS)
• Knowledge of Spring Framework
• Experience with Apache Airflow
• Experience working with SQL databases and Elasticsearch
• Python programming skills
• Experience deploying services on Google Cloud Platform (GCP)
• Familiarity with Maven and Git

What We Offer:

• Benefits package: private healthcare (LuxMed), sports package (Multisport)
• Opportunity to work on global-scale Big Data solutions
• Collaboration with international teams and industry experts
• Modern technology stack and challenging engineering environment