Senior Big Data Engineer/Architect – Scala – Distributed Systems

Deutsche Bank AG, Frankfurt am Main; London; Hybrid; GBP 60,000 - 90,000; Full time

Job summary

A leading global investment bank seeks a Senior Big Data Engineer/Architect with expertise in Scala and Apache Spark for a role focused on modernising their credit risk platform. This position offers the opportunity to work on mission-critical systems at enterprise scale and shape architectural decisions within a dynamic team environment.

Qualifications

• Strong experience in Big Data engineering.
• Deep knowledge of Scala, Apache Spark, and cloud platforms.
• Experience in large-scale enterprise environments.

Responsibilities

• Build, modernise, and re-architect enterprise data systems.
• Migrate systems to Google Cloud Platform (GCP).
• Collaborate with engineering teams on scalable data processing models.

Skills

Scala

Apache Spark

Hadoop

GCP

Kubernetes

CI/CD

Job description

You are here: Home / Job Search / Senior Big Data Engineer/Architect – Scala – Distributed Systems

Job Title: Senior Big Data Engineer/Architect – Scala – Distributed Systems

Location: London

AMS is the world’s leading provider of Talent Acquisition and Management Services. Our Contingent Workforce Solutions (CWS) service, partner with Deutsche Bank to support contingent recruitment processes.

On behalf of Deutsche Bank, we are looking for a Senior Big Data Engineer/Architect with Scala for an initial 6-month contract on a hybrid basis in London.

Deutsche Bank is a global banking business with strong roots in Germany and operations in over 70 countries. Their large but focused footprint gives an established position in Europe plus a significant presence in the Americas and Asia Pacific. There are four business divisions: the Corporate Bank, the Investment Bank, the Private Bank and the Asset Manager DWS. There are also a number of highly skilled functions performing key management tasks.

‘Together we’re sharing new perspectives and transforming what it means to be a bank.’

Purpose of the role:

This is a high-profile technology role within a globally recognised Tier-1 investment bank. Deutsche Bank is seeking a hands-on technologist with deep experience in big data engineering to support a major modernisation effort across its credit risk platform. The role sits at the heart of the bank’s stress testing function, ensuring the business is well-prepared for macroeconomic shocks and meets capital adequacy guidelines (technology experience is key; domain knowledge is not required).

This is an opportunity to work at enterprise scale on mission-critical systems, with a clear business purpose and the chance to influence the end-to-end design. You’ll take the lead in a cross-functional engineering team focused on re-architecting distributed systems, implementing scalable solutions, and migrating services from on-prem to GCP using best-in-class tooling.

If you’re someone who enjoys solving complex data problems, writing robust code, and bringing clarity to legacy environments — while actively influencing architecture decisions — this is a rare chance to do that inside one of the world’s most respected financial institutions.

Key Responsibilities

Build, modernise, and re-architect enterprise data systems.

Migrate on-prem systems to Google Cloud Platform (GCP), leveraging Dataproc, BigQuery, and other GCP-native tooling.

Use technologies such as Apache Spark, Hadoop, and Scala to process large-scale distributed datasets.

Contribute to infrastructure automation (CI/CD) and hybrid cloud deployment pipelines using tools such as GitHub Actions, Renovate, CodeQL, and Quality Gate.

Apply engineering principles to select optimal reengineering approaches (lift-and-shift vs redesign).

Collaborate with architects and senior engineers to define scalable data processing models.

Participate in design reviews, code walkthroughs, and performance optimisations.

Take a methodical, thoughtful approach to coding — focusing on solution quality over speed of delivery.

Be willing to work hands-on across full delivery lifecycle and, if required, step up to contribute to architecture and system design.

Essential Technical Criteria:

Strong Scala development skills with experience in large-scale Big Data environments.

Proficiency in Apache Spark; working knowledge of Hadoop.

Familiarity with GCP (Dataproc, BigQuery) or other public cloud platforms (AWS, Azure).

Experience with Kubernetes or OpenShift (on-prem or hybrid environments).

Understanding of CI/CD pipelines and tools such as GitHub, CodeQL, QualityGate, Renovate.

Nice to Have:

Experience in banking, credit risk, or financial services domains.

Experience with stress testing, risk platforms, or ‘what-if’ scenario-based data modelling.

Deutsche Bank’s values define the working environment they strive to create – diverse, supportive and welcoming of different views. They embrace a culture reflecting a variety of perspectives, insights and backgrounds to drive innovation. They build talented and diverse teams to drive business results and encourage their people to develop to their full potential.

The Bank promotes good working relationships and encourage high standards of conduct and work performance. They welcome applications from talented people from all cultures, countries, races, genders, sexual orientations, disabilities, beliefs, and generations and are committed to providing a working environment free from harassment, discrimination and retaliation.

This client will only accept workers operating via a PAYE engagement model.

AMS’s payroll service is in partnership with Giant, we have worked with them for many years and have good processes in place to ensure you get the best service. If you are successful in your application for this role, your contract will be via Giant. For more information on Giant, please follow this link: https://ams-giant-paye-introduction.

AMS, a Recruitment Process Outsourcing Company, may in the delivery of some of its services be deemed to operate as an Employment Agency or an Employment Business.