Expert Data Engineer Python, Java, Scala, Apache Spark, PySpark, Spark SQL, Quantexa Warszawa, Łódź, Gdańsk, Gdynia

Diverse Consulting Group; Polska; Hybride; PLN 180 000 - 300 000; Plein temps

Avantages offerts par ce poste

Private medical care

Co-financing for the sports card

Constant consultant support

Résumé du poste

Diverse Consulting Group is seeking a Data Engineer to design and implement data pipelines for Capital Markets AML detection. You will work on Spark-based processing, rule frameworks, and scoring components, ensuring robust engineering across data workflows.

The role requires strong Python/Java skills, distributed compute experience, and proficiency with CI/CD tools. Excellent English communication and Agile collaboration are essential for success.

Qualifications

• Strong programming skills in Python and Java.
• Advanced experience with Apache Spark, PySpark, Spark SQL and SQL.
• Proven experience with distributed compute platforms and on-premise cluster environments.
• Proficiency with CI/CD tools such as Bamboo/Jenkins and Bitbucket.
• Experience working in Agile teams and independently in fast-paced, evolving environments.
• Strong analytical and problem-solving skills with the ability to adapt quickly.
• Very good command of English, both spoken and written.

Responsabilités

• Design, implement and optimise data pipelines supporting end-to-end Capital Markets AML detection scenarios.
• Implement detection logic, rule frameworks and scoring components for financial-crime use cases.
• Ensure high-quality engineering across code, data pipelines and operational solutions.

Connaissances

Python

Java

Apache Spark

PySpark

Spark SQL

SQL

Bamboo

Jenkins

Bitbucket

CI/CD tools

Agile

English

Outils

Bamboo

Jenkins

Bitbucket

Description du poste

As a recruitment company, DCG understands that every business is powered by experienced professionals. Our management style and partnership approach enable us to meet your needs and provide continuous support. Due to our ongoing growth and the large number of recruitment projects we undertake for our partners, we are currently looking for:

Responsibilities:

• Design, implement and optimise data pipelines supporting end-to-end Capital Markets AML detection scenarios
• Implement detection logic, rule frameworks and scoring components for financial-crime use cases
• Ensure high-quality engineering across code, data pipelines and operational solutions

Requirements:

• Strong programming skills in Python and Java
• Advanced experience with Apache Spark, PySpark, Spark SQL and SQL for large-scale distributed data processing
• Proven experience with distributed compute platforms and on-premise cluster environments
• Proficiency with CI/CD tools such as Bamboo/Jenkins and Bitbucket
• Experience working in Agile teams and independently in fast-paced, evolving environments
• Strong analytical and problem-solving skills with the ability to adapt quickly
• Very good command of English, both spoken and written

Nice to have:

• Understanding of Capital Markets products, including FX, Equities, Derivatives and Bonds
• Previous experience in Financial Crime, AML or surveillance use cases
• Experience implementing rule-based detection systems, scorecards or alerting frameworks
• Experience delivering NFRs covering performance, scalability, observability, data quality, resiliency and security
• Experience with automation, including automated pipeline deployment, data validation, testing frameworks and workflow orchestration
• Experience integrating solutions with third-party systems, including case management systems
• Ability to collaborate effectively within cross-functional teams with a strong can-do attitude

Offer:

• Private medical care
• Co-financing for the sports card
• Constant support of dedicated consultant

Personal Consulting Agency (License No. 4642)