Senior Data Engineer

Searchability; City Of London; On-site; GBP 70,000 - 85,000; Full time

Job summary

A growing technology consultancy in London is seeking a Cloud Data Engineer to join their Cloud Data Platforms team. This role involves designing and building data pipelines, developing ETL workflows, and creating data solutions using AWS technologies. The ideal candidate has extensive experience with AWS and programming skills in Python and Java. Competitive salary up to £85,000 DoE plus bonuses.

Qualifications

• Strong AWS expertise, including knowledge of tools like Glue, Lambda, Kinesis.
• Solid programming skills in Python, Java, Scala and PySpark.
• Experience with data storage and big data technologies.

Responsibilities

• Build data pipelines for analytics and reporting.
• Develop ETL workflows for data transfer to warehouses and lakes.
• Apply DevOps practices to streamline data processes.
• Design data solutions that support business decision-making.

Skills

AWS

Data Pipelines

ETL

DevOps methodologies

Python

Java

Scala

PySpark

Tools

AWS Glue

AWS Lambda

AWS Kinesis

AWS EMR

AWS DynamoDB

AWS CloudWatch

AWS Redshift

AWS RDS

Hadoop

Job description

• Up to £85,000 DoE plus bonuses
• Active eDV required
• London Location – full-time on-site when required
• Expertise required in AWS, Data Pipelines, ETL, Data Storage, and DevOps methodologies

Role Overview

This role sits within our client’s rapidly growing Cloud Data Platforms team, part of the Insights and Data Global Practice. You will join a multidisciplinary group of data and platform specialists who deliver modern cloud-based transformation for clients across a range of sectors. In this role, you will design and build data pipelines, develop ETL/ELT processes, and create innovative data solutions using the latest cloud technologies and frameworks across AWS.

Responsibilities

• Build data pipelines to ingest, process and transform data for analytics and reporting.
• Develop ETL/ELT workflows to move data efficiently into data warehouses, data lakes and lake houses using open-source and AWS tooling.
• Apply DevOps practices, including CI/CD, infrastructure as code and automation, to improve and streamline data engineering processes.
• Design effective data solutions that meet complex business needs and support informed decision-making.

Experience Required

• Strong AWS expertise, including tools such as Glue, Lambda, Kinesis, EMR, Athena, DynamoDB, CloudWatch, SNS and Step Functions.
• Skilled in modern programming, particularly Python, Java, Scala and PySpark.
• Solid knowledge of data storage and big data technologies, including data warehouses, databases, Redshift, RDS and Hadoop.
• Experience building and managing AWS data lakes on S3 for both structured and unstructured data.

What Happens Next

To apply, please either click online or email directly to [e-mail]. For further information, please call 07719065951 or 0161 4166800. By applying for this role, you give express consent for us to process and submit your application to our client in conjunction with this vacancy only. You may also connect with the hiring manager on LinkedIn by searching for their name. They look forward to hearing from you.