Senior Data Engineer | Cloud ETL & AWS Spark | Remote

Fynity; England; Remote; GBP 72,000 - 88,000; Full time

Benefits offered by this job

Collaboration with skilled professionals

Work with the latest technologies

Opportunities for personal growth

Job summary

A digital transformation consultancy is seeking a Senior Delivery Consultant to join their team as a Data Engineer, focusing on designing and implementing ETL pipelines. The ideal candidate will leverage expertise in Python, Spark, and AWS to provide innovative data solutions for high-profile government clients. This role requires strong experience in cloud-based data engineering and offers the opportunity to work with cutting-edge technologies in a rewarding environment.

Qualifications

• Hands-on experience of designing, implementing, debugging ETL pipelines.
• Excellence in programming with Python, PySpark, and SQL.
• Experience using big data tools like Apache Kafka, Spark, and Airflow.

Responsibilities

• Design and implement ETL pipelines for complex datasets.
• Leverage big data tools to deliver scalable data solutions.
• Collaborate with stakeholders to ensure data quality.

Skills

ETL pipeline design

Python

PySpark

SQL

Apache Kafka

Apache Spark

Airflow

AWS Lambda

AWS Glue

AWS Redshift

GitHub Actions

Terraform

Job description

A digital transformation consultancy is seeking a Senior Delivery Consultant to join their team as a Data Engineer, focusing on designing and implementing ETL pipelines. The ideal candidate will leverage expertise in Python, Spark, and AWS to provide innovative data solutions for high-profile government clients. This role requires strong experience in cloud-based data engineering and offers the opportunity to work with cutting-edge technologies in a rewarding environment.