Lead Apache Hadoop Engineer

Australian Investors Association Limited; London; Hybrid; GBP 75,000 - 95,000; Full time

Job summary

A leading financial services organization is seeking a Lead Apache Hadoop Engineer to join their innovative technology team in London. This role involves the engineering leadership of big data solutions, focusing on building robust architectures within the Apache Hadoop ecosystem. The team is passionate about transforming data into actionable insights, and the position offers hybrid working flexibility, competitive salary, and extensive career growth opportunities. Ideal candidates will possess significant experience in developing data platforms and have a demonstrated ability to mentor junior engineers.

Benefits

Hybrid Working Model

Non-contributory pension

30 days holiday plus bank holidays

Life Assurance and Private Healthcare

Flexible benefits including retail discounts

Qualifications

• Proven experience in architecting, designing, building, and deploying big data platforms using Apache Hadoop.
• Strong expertise in hybrid cloud environments and big data solutions.
• Excellent communication skills for effective global collaboration.

Responsibilities

• Oversee the engineering solutions delivery to meet business objectives.
• Architect and implement an open-source big data platform.
• Ensure compliance with security best practices for all solutions.

Skills

Apache Hadoop

Cloud Platforms (AWS, Azure, GCP)

Kubernetes

Problem-solving

Collaboration

Analytical skills

Education

Bachelor's Degree in Computer Science or related field

Job description

Join to apply for the Lead Apache Hadoop Engineer role at Australian Investors Association

6 days ago Be among the first 25 applicants

Join to apply for the Lead Apache Hadoop Engineer role at Australian Investors Association

Get AI-powered advice on this job and more exclusive features.

Job ID:R0335074 Full/Part-Time: Full-time Regular/Temporary: Regular Listed: 2025-03-19 Location: London

Position Overview

Job Title Lead Apache Hadoop Engineer

Location London

Corporate Title Vice President

Technology serves as the foundation of our entire organization. Our Technology, Data, and Innovation (TDI) strategy aims to enhance engineering capabilities, implement an agile delivery framework, and modernize the bank's IT infrastructure. We are committed to investing in and developing a team of forward-thinking technology professionals, offering them the training, autonomy, and opportunities necessary to engage in groundbreaking work. As a Lead Engineer, you will oversee the comprehensive delivery of engineering solutions to meet business objectives. You will provide engineering leadership across various teams, mentor junior engineers, and promote ongoing enhancements in delivery methodologies. You will have the opportunity to collaborate closely with clients while being part of a larger, creative, and innovative team dedicated to making a significant impact.

In RiskFinder, you will join a local team, collaborating with other teams both in your area and in different geographical locations. You will have the chance to architect, design, and implement an open-source big data platform, enabling clients to produce, access, and analyze extensive datasets through our custom components and applications.

What Well Offer You

A healthy, engaged and well-supported workforce are better equipped to do their best work and, more importantly, enjoy their lives inside and outside the workplace. Thats why we are committed to providing an environment with your development and wellbeing at its centre.

You Can Expect

• Hybrid Working - we understand that employee expectations and preferences are changing. We have implemented a model that enables eligible employees to work remotely for a part of their working time and reach a working pattern that works for them
• Competitive salary and non-contributory pension
• 30 days holiday plus bank holidays, with the option to purchase additional days
• Life Assurance and Private Healthcare for you and your family
• A range of flexible benefits including Retail Discounts, a Bike4Work scheme and Gym benefits
• The opportunity to support a wide ranging CSR programme + 2 days volunteering leave per year
  
  

Your Key Responsibilities

• Develop robust architectures and designs for big data platform and applications within the Apache Hadoop ecosystem
• Implement and deploy big data platform and solutions on-premises and in hybrid cloud environments.
• Read, understand, and modify open-source code to implement bug fixes and perform upgrades.
• Security Architecture: Ensure all solutions adhere to security best practices and compliance requirements.
• Work directly with the Lead Architect and support cross-functional teams globally.
• Strategy Development: Contribute to defining the end-to-end platform engineering and application migration strategy.
  
  

Your Skills And Experience

• Proven experience in architecting, designing, building, and deploying big data platforms and applications using the Apache Hadoop ecosystem in hybrid cloud and private cloud scenarios.
• Experience with hybrid cloud big data platform designs and deployments, especially in AWS, Azure, or GCP.
• Experience in large-scale data platform builds and application migrations. Expert knowledge of Apache Hadoop ecosystem and associated Apache projects (e.g., HDFS, Hive, HBase, Spark, Kafka, Yarn etc.).
• Proficiency in Kubernetes for container orchestration.
• Ability to read and modify open-source code and experience with version upgrades of technology stacks.
• Excellent problem-solving and analytical skills, strong communication and collaboration skills to work effectively with global teams and the ability to work independently and take initiative. You will also ideally have made contributions to open-source projects.
  
  

How Well Support You

• A culture of continuous learning to aid progression
• We value diversity and as an equal opportunities employer, we make reasonable adjustments for those with a disability such as the provision of assistive equipment if required
  
  

About Us

Deutsche Bank is the leading German bank with strong European roots and a global network. Click here to see what we do.

Deutsche Bank in the UK is proud to have been named in The Times Top 50 Employers for Gender Equality 2024 for five consecutive years. Additionally, we have been awarded a Gold Award from Stonewall and named in their Top 100 Employers 2024 for our work supporting LGBTQ+ inclusion.

We strive for a culture in which we are empowered to excel together every day. This includes acting responsibly, thinking commercially, taking initiative and working collaboratively.

Together we share and celebrate the successes of our people. Together we are Deutsche Bank Group.

We welcome applications from all people and promote a positive, fair and inclusive work environment.

Seniority level

• Seniority level

  Mid-Senior level

Employment type

• Employment type

  Temporary

Job function

• Job function

  Information Technology

• Industries

  Software Development

Referrals increase your chances of interviewing at Australian Investors Association by 2x

Get notified about new Hadoop Developer jobs in London, England, United Kingdom.

London, England, United Kingdom 1 week ago

Greater London, England, United Kingdom 3 days ago

London, England, United Kingdom 2 weeks ago

London, England, United Kingdom 1 month ago

London, England, United Kingdom 21 hours ago

London, England, United Kingdom 1 week ago

London, England, United Kingdom 2 days ago

Data Engineer (Python, DBT, Snowflake) – Join a Fast-Growing AI Tech Scale-Up!

London, England, United Kingdom 6 days ago

Greater London, England, United Kingdom 3 weeks ago

Graduate Software Engineer – ML Data Platform

London, England, United Kingdom 1 month ago

London, England, United Kingdom 2 days ago

Data Engineer - AWS Redshift + Kafka - to £100k ID37553

London, England, United Kingdom 1 week ago

London, England, United Kingdom 4 hours ago

London, England, United Kingdom 1 week ago

London, England, United Kingdom 1 month ago

London, England, United Kingdom 1 week ago

London, England, United Kingdom 1 day ago

London, England, United Kingdom 1 month ago

London, England, United Kingdom 1 week ago

London, England, United Kingdom 3 months ago

London, England, United Kingdom 2 weeks ago

London, England, United Kingdom 1 week ago

City Of London, England, United Kingdom £75,000.00-£85,000.00 1 day ago

London, England, United Kingdom 2 weeks ago

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.