Expert Data Engineer Python, Java, Scala, Quantexa, Apache Spark Warszawa, Łódź, Gdańsk, Gdynia

DCG; Polska; Hybrid; PLN 180,000 - 300,000; Full time

Benefits offered by this job

Private medical care

Job summary

DCG is seeking a skilled Data Engineer to design and optimize data pipelines powering AML detection in Capital Markets. You will implement detection rules, scoring components, and ensure high-quality engineering across code and data processing environments.

The role emphasizes fast-paced delivery and collaboration in cross-functional teams. You will work with Python/Java/Scala, Spark, SQL, and Quantexa on distributed on-premise clusters, with CI/CD practices and strong analytical skills.

Qualifications

• Strong programming skills in Python, Java, and Scala.
• Advanced experience with Apache Spark (PySpark) and SQL for large-scale processing.
• Hands-on experience with Quantexa.
• Proven experience with distributed compute platforms and on-premise clusters.
• Proficiency with CI/CD tools such as Bamboo/Jenkins and Bitbucket.
• Experience working in Agile teams and independently in fast-paced environments.
• Strong analytical and problem-solving skills with the ability to adapt.
• Very good command of English, both spoken and written.

Responsibilities

• Design, implement, and optimize data pipelines supporting end-to-end Capital Markets AML detection scenarios.
• Implement detection logic, rule frameworks, and scoring components for financial crime use cases.
• Ensure high-quality engineering across code, data pipelines, and operational processes.
• Contribute to greenfield architecture with ownership, innovation, and delivery focus.

Skills

Python

Java

Scala

Apache Spark

PySpark

SQL

Quantexa

CI/CD

Agile

English

Data pipelines

Tools

Bamboo

Jenkins

Bitbucket

Quantexa

Job description

As a recruitment company, DCG understands that every business is powered by experienced professionals. Our management style and partnership approach enable us to meet your needs and provide continuous support. Due to our ongoing growth and the large number of recruitment projects we undertake for our partners, we are currently looking for:

Responsibilities:

• Design, implement, and optimize data pipelines supporting end-to-end Capital Markets AML detection scenarios
• Implement detection logic, rule frameworks, and scoring components for financial crime use cases
• Ensure high-quality engineering across code, data pipelines, and operational processes
• Contribute to greenfield architecture with ownership, innovation, and focus on delivery excellence

Requirements:

• Strong programming skills in Python, Java, and Scala
• Advanced experience with Apache Spark (PySpark) and SQL for large-scale distributed data processing
• Hands-on experience with Quantexa
• Proven experience with distributed compute platforms and on-premise cluster environments
• Proficiency with CI/CD tools such as Bamboo/Jenkins and Bitbucket
• Experience working in Agile teams and independently in fast-paced, evolving environments
• Strong analytical and problem-solving skills with the ability to adapt quickly
• Very good command of English, both spoken and written

Nice to have:

• Understanding of Capital Markets products, including FX, Equities, Derivatives, and Bonds
• Previous experience in Financial Crime, AML, or surveillance use cases
• Experience implementing rule-based detection systems, scorecards, or alerting frameworks
• Experience delivering against NFRs, including performance, scalability, observability, data quality, resiliency, and security
• Experience with automation, including automated pipeline deployment, data validation, testing frameworks, and workflow orchestration
• Experience integrating solutions with third-party systems, including case management systems
• Strong can-do attitude and ability to collaborate effectively in a cross-functional team

Offer:

• Private medical care
• Co-financing for the sports card
• Constant support of dedicated consultant

Personal Consulting Agency (License No. 4642)