Lead Apache Hadoop Engineer

Deutsche Bank; London; Hybrid; GBP 80,000 - 120,000; Full time

Job summary

Deutsche Bank is seeking a Lead Apache Hadoop Engineer to oversee the delivery of engineering solutions, focusing on big data platforms. This pivotal role involves collaboration with global teams, the opportunity to design and implement open-source solutions, and a commitment to innovative technology practices.

Benefits

Hybrid Working

30 days' holiday plus bank holidays

Life Assurance and Private Healthcare

Flexible benefits including Retail Discounts

Support for CSR initiatives and 2 days' volunteering leave per year

Qualifications

• Experience in architecting and deploying big data applications using Apache Hadoop.
• Hands-on experience with on-premise and cloud-based ecosystems.
• Proficiency in build tools such as Maven and experience with Docker.

Responsibilities

• Develop architectures and designs for big data platforms within the Apache Hadoop ecosystem.
• Implement and deploy big data solutions on-premises and in hybrid cloud environments.
• Address and resolve major issues during application migration.

Skills

Java

Hadoop Ecosystem

Kubernetes

Security Practices

Education

Bachelor's or Master's degree in Computer Science, Engineering

Job description

Social network you want to login/join with:

Lead Apache Hadoop Engineer - Job Description

Location: London

Corporate Title: Vice President

Our Technology, Data, and Innovation (TDI) strategy aims to enhance engineering capabilities, implement an agile delivery framework, and modernize the bank's IT infrastructure. We are committed to investing in and developing a team of forward-thinking technology professionals, offering them training, autonomy, and opportunities to engage in groundbreaking work. As a Lead Apache Hadoop Engineer, you will oversee the comprehensive delivery of engineering solutions to meet business objectives.

In RiskFinder, you will join a local team, collaborating with other teams in your area. You will have the chance to architect, design, and implement an open-source big data platform, enabling clients to produce, access, and analyze extensive datasets through our components and applications.

You will be responsible for the platform engineering and migration strategy for big data applications. The ideal candidate will have substantial hands-on experience with both on-premise and cloud-based ecosystems, Apache open-source projects, Kubernetes, and security protocols. This role demands a proactive senior individual capable of collaborating with global teams to address significant obstacles and facilitate large-scale migrations for critical applications.

What we'll offer you

• Hybrid Working - enabling eligible employees to work remotely part of the time and adopt flexible working patterns
• 30 days' holiday plus bank holidays, with the option to purchase additional days
• Life Assurance and Private Healthcare for you and your family
• Flexible benefits including Retail Discounts, Bike4Work scheme, and Gym benefits
• Support for CSR initiatives and 2 days' volunteering leave per year

Your key responsibilities

• Develop architectures and designs for big data platforms within the Apache Hadoop ecosystem
• Implement and deploy big data solutions on-premises and in hybrid cloud environments
• Read, understand, and modify open-source code for bug fixes and upgrades
• Address and resolve major issues during application migration and contribute to platform engineering strategies

Your skills and experience

• Bachelor's or Master's degree in Computer Science, Engineering, or related field, or equivalent experience
• Proficiency in Java and build tools such as Maven, Bower, and SBT
• Experience in architecting and deploying big data applications using Apache Hadoop in cloud scenarios
• Expertise in Hadoop ecosystem components like HDFS, Hive, HBase, Spark, Ranger, Kafka, YARN
• Knowledge of Kubernetes, Docker, and security practices such as Kerberos, LDAP, SSL
• Ability to read and modify open-source Java repositories

How we'll support you

• Culture of continuous learning and development
• Inclusive environment with reasonable adjustments for disabilities

About us

Deutsche Bank is a leading German bank with a strong European presence and global network. We are committed to diversity and inclusion, recognized by awards such as The Times Top 50 Employers for Gender Equality 2024 and Stonewall's Top 100 Employers 2024. We promote a culture of responsibility, initiative, and collaboration, aiming to empower our people to excel every day.

We welcome applications from all backgrounds and are dedicated to creating a positive, fair, and inclusive workplace.