Lead AWS Data Engineer

Jefferson Frank; Northampton; Hybrid; GBP 60,000 - 80,000; Full time

Job summary

A leading technology company is seeking a Lead Data Engineer for a 6-month contract in Northampton. The role involves developing data pipelines, leading a team, and ensuring efficient data processing using AWS services like PySpark, Glue, and Redshift. Candidates should have over 7 years of relevant experience and be proficient in data security and collaboration for business needs.

Qualifications

• 7+ years of experience in data pipeline design and development.
• Experience leading a team and developing ETL processes.
• Ability to ensure data security and collaborate effectively.

Responsibilities

• Develop complex logic using PySpark in AWS.
• Lead the team in creating scalable and efficient data solutions.
• Design ETL processes and ensure data security.

Skills

PySpark

AWS

Python

SQL

Data processing

Tools

Glue

S3

Redshift

EMR

Kinesis

Job description

Lead Data Engineer - Contract



Location: Northampton (hybrid - need to be in office 2/3 days in a week)

Duration: 6 months

Inside IR35



Job description:

* This will be a Tech Lead who is proficient in developing complex logic using pyspark in AWS along with helping/leading the team.
* 7+ years of experienced in designing, developing complex logic for data pipelines using pyspark in AWS along with helping/leading the team.
* He/she needs to experienced and skilled in PySpark, Glue, Python, SQL and Data processing. This involves designing ETL processes, ensuring data security, and collaborating with other teams for data analysis and business requirements.
* Skilled in scalable, reliable, and efficient data solutions, often using AWS services like S3, Redshift, EMR, Glue, and Kinesis.

Please send CV's to a.otoole@tenthrevolution if you meet each requirement