Big Data Engineer (junior/mid)

ING Hubs Poland; Katowice; On-site; PLN 89,280 - 167,400; Full time

Job summary

ING Hubs Poland is seeking a skilled data-focused engineer to tackle big data challenges. You will work with Spark, Hadoop, Elasticsearch on complex datasets, translating business needs into scalable technical solutions.

The role requires Agile work experience and collaboration with multiple stakeholders. You will contribute to data processing pipelines, ensure best practices in software development, and align with the Global Financial Crime & Fraud Prevention domain.

Qualifications

• Proven big data experience, from an implementation or data science perspective.
• Knowledge of big data technologies (Spark, Hadoop, Elasticsearch).
• Knowledge of relational and non-relational databases.
• Experience in working in an Agile environment.

Responsibilities

• Dealing with both internal and external stakeholders.
• Managing, transforming and cleansing high volume data to help customers solve fraud, compliance and financial crime problems.
• Having regular team sprints and Scrum meetings with the Projects team.
• Working closely with Business Analysts, Technical Leads, Project Managers and Solutions Architects to meet customer expectations and deliver high-quality service.

Skills

Big data

Spark

Hadoop

Elasticsearch

Functional programming

Databases

Agile

Java

C#

CI/CD

OO languages

Job description

We are looking for you if you have:

• Proven big data experience, either from an implementation or a data science prospective,
• Knowledge of big data technologies (Spark, Hadoop, Elasticsearch),
• Knowledge of functional programming,
• Knowledge of relational and non-relational databases,
• Experience in working in an Agile environment,
• Good understanding of customer needs and ability to translate them into highly-effective technical solutions,
• Knowledge how to determine work breakdown and tasking, resolve technical issues, understand technical architectures.
• Knowledge of other Object‑Oriented Programming languages, such as Java or C#, is preferred,
• Good understanding of software development best practices (e.g. clean code, version control, testing, code reviews, CI/CD)

You’ll get extra points for:

• Coding background in Scala,
• Automation and optimisation mindset,
• Good Communications and Presentations skills,
• Facilitation and problem-solving skills,
• Proactive attitude, always on the look-out for improving your and our way of working.
• Experience of building data processing pipelines for use in production “hands off” batch systems, including either traditional ETL pipelines and/or analytics pipelines,

Your responsibilities:

• Dealing with both internal and external stakeholders,
• Managing, transforming and cleansing high volume data, helping our customers solve business problems in the area of fraud, compliance and financial crime,
• Having regular team sprints and Scrum meetings with your Projects team,
• Working closely with Business Analysts, Technical Leads, Project Managers and Solutions Architects, with everyone following the same goal of meeting our customer expectations and delivering a first-class service.

Information about team:

As part of the ING Tech Domain, the mission of Group Services is to support and empower the ING organization to accomplish its goals and ambitions by improving our operational excellence, customer experience and efficiency through the delivery of innovative, stable and scalable technology solutions.

As part of the Global Financial Crime & fraud Prevention(GFCFP) domain, you will be involved with the development of state-of-the-art solutions on relevant topics such as Anti-Money Laundering, Counter Terrorism Financing, Fraud, Sanctions and their global implementation across 40+ countries, affecting 36 million ING customers.

You will be using tools such as Spark, Hadoop, Scala, Data Fusion and Elasticsearch. Our primary language is written in Scala, but don’t worry If that’s not your strongest language or if you haven’t used it before, we make sure that every Quantexa goes through our training academy so they’re comfortable and confident with using our platform.

The expected salary for this position: 8 000 - 15 000 PLN gross monthly

The financial ranges specified in the announcement are adjusted and may differ from the range specified in the remuneration regulations.

The financial ranges specified in the announcement are adjusted and may differ from the range specified in the remuneration regulations.