Big Data Engineer (mid/senior)

ING Hubs Poland; Warszawa; On-site; PLN 107,000 - 201,000; Full time

Job summary

ING Hubs Poland is looking for a Big Data Engineer to join the team in Poland. The role focuses on transforming and cleansing high-volume data to solve fraud and financial crime problems, using Spark, Hadoop, Elasticsearch, and Scala where applicable.

You will work in an Agile environment, collaborating with BAs, Tech Leads, PMs, and Solutions Architects to deliver robust data-driven solutions for customer needs.

Qualifications

• Proven big data experience in implementation or data science.
• Experience with Spark, Hadoop, Elasticsearch.
• Knowledge of relational and non-relational databases.
• Experience in Agile environments.
• Understanding customer needs and translating into technical solutions.
• Familiar with Java or C# and software development best practices (CI/CD, clean code, version control).

Responsibilities

• Dealing with internal and external stakeholders.
• Managing, transforming and cleansing high-volume data to solve fraud and financial crime problems.
• Holding regular team sprints and Scrum meetings.
• Collaborating with Business Analysts, Tech Leads, Project Managers and Solutions Architects to meet customer expectations.

Skills

Big data experience

Spark

Hadoop

Elasticsearch

Functional programming

Agile

Java/C#

CI/CD

Tools

Spark

Hadoop

Elasticsearch

Scala

Data Fusion

Job description

ING Hubs Poland is hiring!

The expected salary for this position: 9 600 - 18 000 PLN gross monthly

Financial ranges specified in the announcement are adjusted and may differ from the range specified in the remuneration regulations.

We Are Looking For You If You Have

• Proven big data experience, either from an implementation or a data science perspective,
• Knowledge of big data technologies (Spark, Hadoop, Elasticsearch),
• Knowledge of functional programming,
• Knowledge of relational and non-relational databases,
• Experience in working in an Agile environment,
• Good understanding of customer needs and ability to translate them into highly-effective technical solutions,
• Knowledge how to determine work breakdown and tasking, resolve technical issues, understand technical architectures,
• Knowledge of other Object-Oriented Programming languages, such as Java or C#, is preferred,
• Good understanding of software development best practices (e.g. clean code, version control, testing, code reviews, CI/CD).

You’ll Get Extra Points For

• Coding background in Scala,
• Automation and optimisation mindset,
• Good Communications and Presentations skills,
• Facilitation and problem-solving skills,
• Proactive attitude, always on the look-out for improving your and our way of working,
• Experience of building data processing pipelines for use in production “hands off” batch systems, including either traditional ETL pipelines and/or analytics pipelines.

Your Responsibilities

• Dealing with both internal and external stakeholders,
• Managing, transforming and cleansing high volume data, helping our customers solve business problems in the area of fraud, compliance and financial crime,
• Having regular team sprints and Scrum meetings with your Projects team,
• Working closely with Business Analysts, Technical Leads, Project Managers and Solutions Architects, with everyone following the same goal of meeting our customer expectations and delivering a first-class service.

Information About Team

As part of the ING Tech Domain, the mission of Group Services is to support and empower the ING organization to accomplish our goals and ambitions by improving our operational excellence, customer experience and efficiency through the delivery of innovative, stable and scalable technology solutions.

As part of the Global Financial Crime & fraud Prevention(GFCFP) domain, you will be involved with the development of state-of-the-art solutions on relevant topics such as Anti-Money Laundering, Counter Terrorism Financing, Fraud, Sanctions and their global implementation across 40+ countries, affecting 36 million ING customers.

You will be using tools such as Spark, Hadoop, Scala, Data Fusion and Elasticsearch. Our primary language is written in Scala, but don’t worry If that’s not your strongest language or if you haven’t used it before, we make sure that every Quantexa goes through our training academy so they’re comfortable and confident with using our platform.

The role naming convention in the global ING job architecture will be “Engineer II" or "Engineer III".