Data Engineer

AND Digital; Birmingham; On-site; GBP 60,000 - 80,000; Full time

Job summary

A technology consultancy is seeking a Senior Data Engineer in Birmingham to lead data engineering efforts, including developing and maintaining data pipelines. Ideal candidates will have over 3 years of experience with data technologies and Agile methodologies. Responsibilities include transforming data and collaborating with different teams. The position promises a supportive environment focused on wellbeing, diversity, and growth within the company.

Qualifications

• 3+ years of experience in data engineering, data science, or analytics.
• Hands-on experience with CI/CD and DevOps practices.
• Experience with both modern and traditional data technologies.

Responsibilities

• Develop, deploy, and maintain data pipelines.
• Extract and transform data from multiple sources.
• Collaborate with tech leads on system integrations.

Skills

MongoDB

PostgreSQL

mySQL/mariaDB

Kafka

Python

AWS RDS

Snowflake

Data Warehousing

CI/CD

Agile methodologies

Tools

Splunk

ETL technologies

Job description

Senior Data Engineer (Birmingham)

AND Introduction

At AND, we accelerate the development of digital capabilities. In practice, that means helping ambitious leaders and organisations build the teams, products, processes and even operational structures they need to close the digital skills gap within their organisation today, so that they thrive tomorrow.

Clients rely on our experience, agility and craft skills across tech and business strategy, software development and product management to address some of the toughest challenges facing their businesses.

We bring aboard thinkers, tinkerers, passionate software craftspeople and inspiring technologists to help us solve these challenges. Together, we’re united by a sense of pragmatism, purpose and a deeply-held belief that digital products and technology alone won’t transform a business or save the world: it’s the people that count.

About You

As a Senior Data Engineer, you will spend your time helping clients achieve their data engineering needs. Primarily the development, deployment and maintenance of data pipelines in a fast moving, Agile environment.

You’ll also make a real impact by taking an active role in the team’s Agile Development practices, technical decision making and development, generating value and continuously striving to improve the quality and reliability of our data and processes.

You will spend the majority of your time helping deliver client data engineering opportunities and supporting the growth of our junior-mid level technologists; both within AND and for our clients. This will include…

Being able to:

• Extract data from multiple data sources
• Write code to ingest or transform new and existing data
• Transform data in various ways to support data scientists and product analysts
• Build and design a scalable and extensible data architecture
• Conduct large scale batch and real‑time processing from varying sources
• Influence the client on how they approach data engineering issues
• Collaborate with tech leads on system integrations

Influencing technical direction

• Engaging actively with our Consultancy Data Strategy and Insight practice, to help define and materialise clients’ data strategies
• Championing and upholding high technical quality standards

To do that, it’s essential you bring the following:

• Experience of using modern and traditional data technologies including: MongoDB, PostgreSQL, mySQL/mariaDB, Kafka, Splunk/ELK or other logging and monitoring tools, BI and Data Warehousing solutions and ETL and migration technologies
• Experience with Snowflake, Sigma and Fabric.
• Good cloud‑native data engineering skills e.g. AWS RDS, Redshift, Kinesis, Glue or Azure CosmosDB, DataFactory, SQL DB etc.
• Good experience in quality assuring data programmes, including non‑functional testing and performance tuning
• At least 3 years experience writing Python, R, SQL or Scala
• Experience in Dimensional modelling and Data Warehouse patterns
• Good understanding and track record of delivering complex data solutions using Agile methods including Scrum, SAFe etc.
• Hands‑on experience of modern software delivery, including CI/CD and DevOps practices
• Experience with Big data storage or Data Lakes
• A keen understanding of industry best‑practice around standards, quality and continuous improvement in the field of Data Engineering
• Experience in the field of Data Engineering, Science or Analytics

It’s helpful if you also have:

• Consultancy or professional services experience across a number of sectors
• Javascript / Typescript / NodeJS experience
• Experience with Hadoop, Spark, Redshift or Parquet
• Coaching and providing career progression to junior and mid‑level developers, supporting developers create exciting and inspiring career ambitions

Joining AND

From the work we deliver, to the way we serve and support our people, we work hard to ensure that there’s nowhere quite like AND. But joining a company is a two‑way street: the fit has to work on both sides. So before you apply, here’s three key things to understand about us:

• We’re built for people - like, real humans. Not ‘resources’ or ‘staff’. That means happiness and wellbeing really do matter to us, and we hate unnecessary hierarchy and bureaucracy.
• There’s no well‑trodden path ahead: AND is growing fast and forging a new trail. That’s exciting, and gives us all the autonomy and opportunity we love - but bear in mind it also demands focus, patience and resilience.
• Diversity is a priority. After all, to build great products that a wide variety of different people love to use, we need a wide variety of people to help us build them. So diversity is more than a policy or a word: it’s business critical for us.