Scala/Spark Data Engineer - AML Pipelines (Azure)

Adecco; City Of London; On-site; GBP 65,000 - 90,000; Part time

Job summary

Quantexa is seeking a hands-on Data Engineer to design, build, and optimise scalable data pipelines and ETL processes in a global banking AML environment. You will work with Scala, Spark, Python and SQL to develop cloud-based data solutions and entity resolution capabilities.

The role involves collaborating with technology, product and business stakeholders to grow a new Quantexa capability across EMEA, with 2-3 days in the office per week and umbrella company setup.

Qualifications

• Strong Data Engineering background.
• Hands-on experience with Scala and Spark.
• Experience with SQL and Python.
• Experience with Azure Data Factory, Azure Databricks and cloud data platforms.
• ETL and data pipeline development expertise.
• Experience with Elasticsearch, APIs and modern engineering practices.
• Exposure to Quantexa would be highly desirable.
• Financial Services experience beneficial but not essential.

Responsibilities

• Design, build and optimise scalable data pipelines and ETL processes.
• Develop solutions using Scala, Spark, Python and SQL.
• Support the implementation and growth of the Quantexa platform.
• Build reusable frameworks and shared engineering capabilities.
• Work across Azure, Databricks and cloud-based data platforms.
• Ensure data quality, integrity, security and platform reliability.
• Support testing, deployment and automation activities.
• Collaborate with global teams to deliver high-quality solutions.

Skills

Scala

Spark

SQL

Python

Tools

Azure Databricks

Azure Data Factory

Elasticsearch

APIs

Job description

Quantexa is seeking a hands-on Data Engineer to design, build, and optimise scalable data pipelines and ETL processes in a global banking AML environment. You will work with Scala, Spark, Python and SQL to develop cloud-based data solutions and entity resolution capabilities.

The role involves collaborating with technology, product and business stakeholders to grow a new Quantexa capability across EMEA, with 2-3 days in the office per week and umbrella company setup.