Senior Data Engineer – Python/Java, Spark, AML

Diverse Consulting Group; Polska; Hybrid; PLN 180,000 - 300,000; Full time

Benefits offered by this job

Private medical care

Co-financing for the sports card

Constant consultant support

Job summary

Diverse Consulting Group is seeking a Data Engineer to design and implement data pipelines for Capital Markets AML detection. You will work on Spark-based processing, rule frameworks, and scoring components, ensuring robust engineering across data workflows.

The role requires strong Python/Java skills, distributed compute experience, and proficiency with CI/CD tools. Excellent English communication and Agile collaboration are essential for success.

Qualifications

• Strong programming skills in Python and Java.
• Advanced experience with Apache Spark, PySpark, Spark SQL and SQL.
• Proven experience with distributed compute platforms and on-premise cluster environments.
• Proficiency with CI/CD tools such as Bamboo/Jenkins and Bitbucket.
• Experience working in Agile teams and independently in fast-paced, evolving environments.
• Strong analytical and problem-solving skills with the ability to adapt quickly.
• Very good command of English, both spoken and written.

Responsibilities

• Design, implement and optimise data pipelines supporting end-to-end Capital Markets AML detection scenarios.
• Implement detection logic, rule frameworks and scoring components for financial-crime use cases.
• Ensure high-quality engineering across code, data pipelines and operational solutions.

Skills

Python

Java

Apache Spark

PySpark

Spark SQL

SQL

Bamboo

Jenkins

Bitbucket

CI/CD tools

Agile

English

Tools

Bamboo

Jenkins

Bitbucket

Job description

Diverse Consulting Group is seeking a Data Engineer to design and implement data pipelines for Capital Markets AML detection. You will work on Spark-based processing, rule frameworks, and scoring components, ensuring robust engineering across data workflows.

The role requires strong Python/Java skills, distributed compute experience, and proficiency with CI/CD tools. Excellent English communication and Agile collaboration are essential for success.