Senior Data Engineer (AWS) - Pipelines & Data Lake

Noir; Manchester; Hybrid; GBP 90,000 - 120,000; Full time

Job summary

Noir is seeking a Senior Data Engineer to join the Manchester data team and drive the evolution of the company’s data infrastructure. You will develop sophisticated data integrations with multiple platforms, real-time data solutions, and automation to enable robust business intelligence.

The role focuses on designing, building, and maintaining robust data pipelines and ETL processes using AWS services, while contributing to cloud migration, data quality, and architectural solutions.

Qualifications

• Strong experience building data pipelines and ETL architectures.
• Proficient in Python, SQL and PySpark.
• Hands-on AWS data services experience.
• Experience communicating with stakeholders and mentoring juniors.

Responsibilities

• Design, develop and maintain robust data pipelines and ETL processes.
• Develop real-time data solutions and enhance automation.
• Lead data quality initiatives and data governance.
• Contribute to cloud migration and architectural solutions.
• Provide technical guidance to junior engineers and liaise with stakeholders.

Skills

Python

SQL

PySpark

AWS

ETL design

Data warehousing

Agile

Communication

Cloud migration

Tools

AWS Glue

AWS Lambda

AWS S3

AWS Redshift

Amazon EMR

Data Lakehouse

Pipeline Orchestration

Job description

Noir is seeking a Senior Data Engineer to join the Manchester data team and drive the evolution of the company’s data infrastructure. You will develop sophisticated data integrations with multiple platforms, real-time data solutions, and automation to enable robust business intelligence.

The role focuses on designing, building, and maintaining robust data pipelines and ETL processes using AWS services, while contributing to cloud migration, data quality, and architectural solutions.