Lead AWS Data Engineer

ZipRecruiter; Northampton; Hybrid; GBP 60,000 - 80,000; Full time

Job summary

A leading technology company is seeking a Lead Data Engineer for a 6-month contract in Northampton. The role requires extensive experience in AWS and PySpark, focusing on developing and leading data engineering solutions while ensuring security and collaboration across teams. This is a hybrid position requiring some in-office presence for effective teamwork.

Qualifications

• 7+ years of experience in designing and developing data pipelines.
• Proficient in AWS services and PySpark.
• Experience in creating scalable and efficient data solutions.

Responsibilities

• Lead the development of complex logic using PySpark.
• Ensure data security and collaborate with teams for data analysis.
• Design ETL processes to meet business requirements.

Skills

PySpark

Glue

Python

SQL

Data processing

Tools

AWS

S3

Redshift

EMR

Kinesis

Job description

Job Description

Lead Data Engineer - Contract

Location: Northampton (hybrid - need to be in office 2/3 days in a week)

Duration: 6 months

Inside IR35

Job description:

• This will be a Tech Lead who is proficient in developing complex logic using pyspark in AWS along with helping/leading the team.




• 7+ years of experienced in designing, developing complex logic for data pipelines using pyspark in AWS along with helping/leading the team.




• He/she needs to experienced and skilled in PySpark, Glue, Python, SQL and Data processing. This involves designing ETL processes, ensuring data security, and collaborating with other teams for data analysis and business requirements.




• Skilled in scalable, reliable, and efficient data solutions, often using AWS services like S3, Redshift, EMR, Glue, and Kinesis.

Please send CV's to a.otoole@tenthrevolution if you meet each requirement