Lead Apache Hadoop Engineer

Australian Investors Association Limited; London; Hybrid; GBP 70,000 - 110,000; Full time

Job summary

An established industry player is seeking a Lead Apache Hadoop Engineer to drive innovative solutions in big data. This role involves overseeing engineering projects, mentoring junior engineers, and collaborating with clients to deliver impactful results. The company offers a hybrid working model, competitive salary, and a culture of continuous learning and inclusivity. Join a forward-thinking team dedicated to enhancing technology capabilities and making a significant difference in the industry.

Benefits

Hybrid Working model

30 days holiday plus bank holidays

Life Assurance

Private Healthcare

Flexible benefits

Support for CSR initiatives

Volunteering leave

Qualifications

• Experience in architecting and deploying big data platforms using Hadoop.
• Proficiency with Hadoop ecosystem projects like HDFS, Hive, and Spark.

Responsibilities

• Develop architectures and designs for big data platforms within the Apache Hadoop ecosystem.
• Implement and deploy solutions on-premises and in hybrid cloud environments.

Skills

Hadoop

AWS

Azure

GCP

HDFS

Hive

HBase

Spark

Kafka

Kubernetes

Job description

Join to apply for the Lead Apache Hadoop Engineer role at Australian Investors Association

Get AI-powered advice on this job and more exclusive features.

Job ID: R0335074 | Full/Part-Time: Full-time | Regular/Temporary: Regular | Listed: 2025-03-19 | Location: London

Position Overview

Job Title: Lead Apache Hadoop Engineer

Location: London

Corporate Title: Vice President

Technology serves as the foundation of our organization. Our Technology, Data, and Innovation (TDI) strategy aims to enhance engineering capabilities, implement an agile delivery framework, and modernize the bank's IT infrastructure. We are committed to investing in and developing a team of forward-thinking technology professionals, offering them training, autonomy, and opportunities for groundbreaking work.

As a Lead Engineer, you will oversee the delivery of engineering solutions, provide leadership across teams, mentor junior engineers, and promote ongoing enhancements in delivery methodologies. You will collaborate closely with clients and be part of a creative, innovative team dedicated to making a significant impact.

What We Offer

• Hybrid Working model enabling remote work part of the time
• Competitive salary and non-contributory pension
• 30 days holiday plus bank holidays, with options to purchase additional days
• Life Assurance and Private Healthcare for you and your family
• Flexible benefits including Retail Discounts, Bike4Work scheme, and Gym benefits
• Support for CSR initiatives and 2 days volunteering leave per year

Your Key Responsibilities

• Develop architectures and designs for big data platforms within the Apache Hadoop ecosystem
• Implement and deploy solutions on-premises and in hybrid cloud environments
• Modify open-source code for bug fixes and upgrades
• Ensure solutions adhere to security and compliance standards
• Work with global teams and contribute to platform and migration strategies

Your Skills and Experience

• Experience in architecting and deploying big data platforms using Hadoop in cloud scenarios (AWS, Azure, GCP)
• Proficiency with Hadoop ecosystem projects like HDFS, Hive, HBase, Spark, Kafka, Yarn
• Experience with Kubernetes and open-source code modification
• Strong problem-solving, communication, and collaboration skills
• Open-source contributions are a plus

How We Support You

• Continuous learning culture
• Inclusive environment with reasonable adjustments for disabilities

About Us

Deutsche Bank, a leading German bank with a global network, values diversity and inclusion. Recognized as a top employer for gender equality and LGBTQ+ inclusion, we foster a culture of responsibility, collaboration, and excellence. We welcome applications from all backgrounds and promote a positive, fair, and inclusive work environment.

Additional Details

• Seniority level: Mid-Senior level
• Employment type: Temporary
• Job function: Information Technology
• Industries: Software Development