Senior Data Engineer

Made Tech; Bristol; On-site; GBP 60,000 - 80,000; Full time

Job summary

A leading company in technology consulting is seeking a Senior Data Engineer to enable public sector organizations to leverage data effectively. This hands-on role requires strong expertise in data engineering, DevOps practices, and the ability to support client teams while providing high-quality data services. The ideal candidate will have experience with cloud infrastructure and data transformation processes, contributing to a culture focused on continuous learning and development.

Benefits

30 days Holiday

Flexible Parental Leave

Remote Working

Paid Counselling

Qualifications

• Hands-on experience in data engineering.
• Ability to create and manage data pipelines.
• Strong experience in cloud environments and DevOps practices.

Responsibilities

• Develop, operate, and maintain data platforms and services.
• Ensure maximum value to data consumers.
• Support project engineering and upskill client teams.

Skills

Git

Data Transformation

DevOps

Agile Practices

Cloud Infrastructure

Data Pipelines

Data Processing

Tools

Apache Spark

Databricks

Hadoop

Docker

Job description

This job is brought to you by Jobs/Redefined, the UK's leading over-50s age inclusive jobs board.

Senior Data Engineer

Department: Technology

Employment Type: Permanent

Location: Any UK Office Hub (Bristol / London / Manchester / Swansea)

Compensation: GBP 60,000 - GBP 80,000 / year

Description

Our Senior Data Engineers enable public sector organisations to embrace a data-driven approach by providing data platforms and services that are high-quality, cost-efficient, and tailored to clients' needs. They develop, operate, and maintain these services. They make sure they provide maximum value to data consumers, including analysts, scientists, and business stakeholders.

Your role at Made Tech

As a Senior Data Engineer, you may play one or more roles according to our clients' needs. The role is very hands-on and you'll support as a senior contributor for a project, focusing on both delivering engineering work as well as upskilling members of the client team. At other points, you might play more of a technical architect role and work with the larger MadeTech team to identify growth opportunities within the account.

You'll need to have a drive to deliver outcomes for users. You'll make sure that the wider context of a delivery is considered and maintain alignment between the operational and analytical aspects of the engineering solution.

Skills, Knowledge & Expertise

We are looking for candidates with a range of skills and experience, please apply even if you don't meet all the criteria.

• Enthusiasm for learning and self-development
• Proficiency in Git (inc. Github Actions) and able to explain the benefits of different branch strategies
• Gathering and meeting the requirements of both clients and users on a data project
• Strong experience in IaC and able to guide how one could deploy infrastructure into different environments
• Owning the cloud infrastructure underpinning data systems through a DevOps approach
• Knowledge of handling and transforming various data types (JSON, CSV, etc) with Apache Spark, Databricks or Hadoop
• Good understanding of the possible architectures involved in modern data system design (e.g. Data Warehouse, Data Lakes and Data Meshes) and the different use cases for them
• Ability to create data pipelines on a cloud environment and integrate error handling within these pipelines. With an understanding how to create reusable libraries to encourage uniformity of approach across multiple data pipelines.
• Able to document and present an end-to-end diagram to explain a data processing system on a cloud environment, with some knowledge of how you would present diagrams (C4, UML etc.)
• To provide guidance how one would implement a robust DevOps approach in a data project. Also would be able to talk about tools needed for DataOps in areas such as orchestration, data integration and data analytics.
• Experience in improving resilience into a project by checking for software vulnerabilities and implement appropriate testing strategies (unit, integration, data quality etc.)
• Knowledge of SOLID, DRY and TDD principles and how to practically implement these into a project.
• Agile practices such as Scrum, XP, and/or Kanban
• Designing and implementing efficient data transformation processes at scale, both in batch and streaming use cases
• Owning the cloud infrastructure underpinning data systems through a DevOps approach
• Agile practices such as Scrum, XP, and/or Kanban
• People skills such as mentoring, supportive team player and performing line management duties
• To be able to demonstrate a commercial mindset when on projects to grow accounts organically with senior stakeholders

Desirable experience

Experience in the following things isn't essential, but it's highly desirable!

• Working at a technology consultancy
• Working with Docker and virtual environments as part of the development and CI/CD process.
• Working with senior stakeholders to gather requirements and keep them engaged with
• Experience in working with a team of engineers using a variety of techniques such as pair programming or mob programming.
• Working with data scientists to productionise advanced data deliverables, such as machine learning models
• Working knowledge of statistics
• Working with multidisciplinary digital and technology teams
• Working within the public sector

Job Benefits

Support in applying

If you need this job description in another format, or other support in applying, please email [e-mail].

We believe we can use tech to make public services better. We also believe this can happen best when our own team represents the society that actually uses the services we work on. We're collectively continuing to grow a culture that is happy, healthy, safe and inspiring for people of all backgrounds and experiences, so we encourage people from underrepresented groups to apply for roles with us.

When you apply, we'll put you in touch with a talent partner who can help with any needs or adjustments we may need to make to help with your application. This includes alternative formats for documents, the time allotted for interviews and any other needs. We also welcome any feedback on how we can improve the experience for future candidates.

We're committed to building a happy, inclusive and diverse workforce. You can get a sense of what it's like working here from our blog, where we talk about mental health, communities of practice and neurodiversity (as well as our client work and best practice).

Like many organisations, we use Slack to foster a sense of community and connection. As well as special interest groups such as music, food and pets, we also have 10+ Slack channels dedicated to specific communities, allies, and identities as well as dedicated learning spaces called communities of practice (COPs). If you'd like to speak to someone from one of these groups about their experience as an employee, please do let a member of the Made Tech talent team know.

Benefits

We are always listening to our growing teams and evolving the benefits available to our people. As we scale, as do our benefits and we are scaling quickly. We've recently introduced a flexible benefit platform which includes a Smart Tech scheme, Cycle to work scheme, and an individual benefits allowance which you can invest in a Health care cash plan or Pension plan. We're also big on connection and have an optional social and wellbeing calendar of events for all employees to join should they choose to.

Here are some of our most popular benefits listed below:

30 days Holiday - we offer 30 days of paid annual leave + bank holidays!

Flexible Parental Leave - we offer flexible parental leave options

Remote Working - we offer part time remote working for all our staff

Paid counselling - we offer paid counselling as well as financial and legal advice.

An increasing number of our customers are specifying a minimum of SC (security check) clearance in order to work on their projects. As a result, we're looking for all successful candidates for this role to have eligibility.Eligibility for SC requires 5 years' of continuous UK residency. Please note that if at any point during the interview process it is apparent that you may not be eligible for SC, we won't be able to progress your application and we will contact you to let you know why.