Senior Data Engineer

Fynity; England; Remote; GBP 72,000 - 88,000; Full time

Benefits offered by this job

Collaboration with skilled professionals

Work with the latest technologies

Opportunities for personal growth

Job summary

A digital transformation consultancy is seeking a Senior Delivery Consultant to join their team as a Data Engineer, focusing on designing and implementing ETL pipelines. The ideal candidate will leverage expertise in Python, Spark, and AWS to provide innovative data solutions for high-profile government clients. This role requires strong experience in cloud-based data engineering and offers the opportunity to work with cutting-edge technologies in a rewarding environment.

Qualifications

• Hands-on experience of designing, implementing, debugging ETL pipelines.
• Excellence in programming with Python, PySpark, and SQL.
• Experience using big data tools like Apache Kafka, Spark, and Airflow.

Responsibilities

• Design and implement ETL pipelines for complex datasets.
• Leverage big data tools to deliver scalable data solutions.
• Collaborate with stakeholders to ensure data quality.

Skills

ETL pipeline design

Python

PySpark

SQL

Apache Kafka

Apache Spark

Airflow

AWS Lambda

AWS Glue

AWS Redshift

GitHub Actions

Terraform

Job description

Senior Delivery Consultant @ Fynity, placing highly skilled talent within the cloud technology sector ☁️

Data Engineer – SC Cleared (or Clearable)

Location: Remote/ London, occasional visits to London

Salary: Up to £80,000

Start Date: ASAP

About the Role

Join a dynamic Digital Transformation Consultancy as a Data Engineer and play a pivotal role in delivering innovative, data‑driven solutions for high‑profile government clients. You’ll be responsible for designing and implementing robust ETL pipelines, leveraging cutting‑edge big data technologies, and driving excellence in cloud‑based data engineering.

This role offers the opportunity to work with leading technologies, collaborate with data architects and scientists, and make a significant impact in a fast‑paced, challenging environment.

Key Responsibilities

• Design, implement, and debug ETL pipelines to process and manage complex datasets.
• Leverage big data tools, including Apache Kafka, Spark, and Airflow, to deliver scalable solutions.
• Collaborate with stakeholders to ensure data quality and alignment with business goals.
• Utilize programming expertise in Python, Scala, and SQL for efficient data processing.
• Build data pipelines using cloud‑native services on AWS, including Lambda, Glue, Redshift, and API Gateway.
• Monitor and optimise data solutions using AWS CloudWatch and other tools.

What We’re Looking For

• Good hands‑on experience of designing, implementing, debugging ETL pipeline
• Expertise in Python, PySpark and SQL languages
• Expertise with Spark and Airflow
• Experience of designing data pipelines using cloud native services on AWS
• Extensive knowledge of AWS services like API Gateway, Lambda, Redshift, Glue, Cloudwatch, etc.
• Iac experience of deploying AWS resources using terraform
• Hands‑on experience of setting up CI/CD workflows using GitHub Actions

SC Clearance Criteria

• Must be a British Citizen or have resided in the UK for at least 5 consecutive years.
• Detailed employment history for the past 10 years or longer may be required.

Why Join Us?

• Be part of a forward‑thinking consultancy driving digital transformation for industry leaders.
• Work with the latest big data and cloud technologies.
• Collaborate with a team of skilled professionals in a fast‑paced and rewarding environment.

If you’re passionate about delivering impactful data solutions and meet the criteria for this role, we’d love to hear from you. Apply today and lead the way in digital transformation!

Seniority level

Mid‑Senior level

Employment type

Full‑time

Job function

Information Technology

Industries

IT Services and IT Consulting and IT System Data Services