Lead Data Engineering

BT Group; Southampton; On-site; GBP 50,000 - 70,000; Full time

Job summary

A leading company seeks a Data Engineer to design and build scalable data products, guiding a team of junior engineers. The ideal candidate is experienced in big data technologies such as Hadoop, GCP, and AWS, and has strong leadership skills. The role includes opportunities for professional development and competitive benefits.

Benefits

10% on target bonus

Life Assurance Cover

Exclusive discounts on BT services

18 weeks family leave at full pay

Enhanced women’s health support

25 days annual leave

24/7 virtual GP appointments

2 weeks carer’s leave

Training and development opportunities

Qualifications

• Proficient in at least two of: Hadoop, GCP, or AWS.
• Hands-on experience with CI/CD strategies.
• Experience in people management or desire to manage.

Responsibilities

• Design and lead the development of scalable data products.
• Manage a small team of junior data engineers.
• Collaborate on data product improvements.

Skills

Hadoop

GCP

AWS

Scala

Java

Continuous Integration

Infrastructure as Code

Git

SVN

Tools

Confluence

JIRA

Job description

Social network you want to login/join with:

• This is a developer first role in which you will design, build, and lead on the development and support of scalable data products for our business stakeholders.
• Agile development through story planning, estimation and retrospectives.
• Lead the continual improvement of our solutions, i.e. process improvements / operational monitoring / automation opportunities / security.
• Provide leadership to our other Data engineering development and support team, contribute to upkeep of our strategic data platform architecture, the data engineering community and associated standards.
• Collaborate with architects, designers, analysts, product specialists, other software and data engineers – in the support of our data products.
• Continual improvements using engineering excellence best practices.
• Demos and knowledge transfers to stakeholders around product developments.
• Spread your experience and knowledge to junior engineers.
• Improve automated testing and deployments using CI/CD pipelines.
• Expectation to line manage small team of junior data engineers.
• Continual learning through internal and external training.

What you'll bring

Mandatory

• Proficient in at least two of the following: Hadoop, GCP or AWS for creating Big Data solutions.
• Skilled in using technologies such as Scala or Java.
• Hands-on experience with Continuous Integration and Deployment strategies.
• Solid understanding of Infrastructure as Code tools.
• Experienced in using Confluence, JIRA, or other Atlassian tools.
• Knowledgeable in software version control with Git or SVN.
• Capable of presenting technical issues and successes to team members and Product Owners.
• Has experience of people management or desire to manage individuals on the team

Nice to Have

• Experience with some of these- Python, Spark, Kafka, Kinesis, Kinesis Analytics, BigQuery, Dataflow, BigTable, and SQL.
• Enthusiastic about learning and applying new technologies (growth mindset).
• Ability to build new solutions and support our data solutions/products.

What's in it for you

• 10% on target bonus
• Life Assurance Cover
• Exclusive colleague discounts on our latest and greatest BT broadband packages, BT TV with TNT Sports and NOW Entertainment
• From January 2025, equal family leave: receive 18 weeks at full pay, 8 weeks at half pay and 26 weeks at the statutory rate. It’s for all parents, no matter how your family is made up.
• Enhanced women’s health support: including help with menopause symptoms, cancer screenings, period care and more.
• 25 days annual leave (not including bank holidays), increasing with service
• 24/7 private virtual GP appointments for UK colleagues
• 2 weeks carer’s leave
• World-class training and development opportunities