Senior Data Engineer - AWS Data Pipelines & Real-Time

Noir; Manchester; On-site; GBP 75,000 - 110,000; Full time

Job summary

Noir is seeking aSenior Data Engineer to join its data engineering team in Manchester. You will own the design, development, and maintenance of robust data pipelines and ETL processes using AWS services, enabling real-time data solutions and business intelligence.

Essential skills include Python, SQL, PySpark, and experience with data lakehouse architectures and data warehousing. Strong communication and Agile experience are required for stakeholder collaboration.

Qualifications

• Experience designing and maintaining robust data pipelines.
• Proficient with AWS data services (Glue, Lambda, S3, Redshift, EMR).
• Strong Python, SQL, PySpark and data warehousing knowledge.
• Experience with data lakehouse architectures.
• Excellent communication with stakeholders.

Responsibilities

• Design, develop, and maintain data pipelines and ETL processes.
• Contribute to cloud migration and architectural solutions.
• Ensure data quality and integrity.
• Provide technical guidance to juniors.
• Collaborate with technical and non-technical stakeholders.

Skills

Data pipelines

ETL processes

Python

SQL

PySpark

AWS proficiency

Agile experience

Communication skills

Tools

AWS Glue

AWS Lambda

AWS S3

AWS Redshift

Amazon EMR

Airflow

Job description

Noir is seeking aSenior Data Engineer to join its data engineering team in Manchester. You will own the design, development, and maintenance of robust data pipelines and ETL processes using AWS services, enabling real-time data solutions and business intelligence.

Essential skills include Python, SQL, PySpark, and experience with data lakehouse architectures and data warehousing. Strong communication and Agile experience are required for stakeholder collaboration.