Remote Senior Data Engineer | Scalable Data Pipelines

Nova Hunte Ltd; Greater London; Remote; GBP 90,000 - 130,000; Full time

Benefits offered by this job

Remote work

Long-term contract

Job summary

Nova Hunte Ltd is seeking a Senior Data Engineer to design, build and maintain scalable data pipelines using Python and PySpark in a remote, long-term contract with a London-based client.

You will work on AWS data services, data lakes, ETL/ELT, data modelling, and real-time processing, collaborate with product teams, mentor juniors, and ensure performance, security and observability across the data platform.

Qualifications

• 8+ years of data engineering experience.
• Proficient in Python and PySpark; strong SQL and data modelling.
• Extensive AWS data services experience and data lake/platform design.
• Experience with NoSQL databases, OpenSearch/Elasticsearch, and streaming tools.
• Strong ETL/ELT, data governance, and performance optimization.

Responsibilities

• Design and develop large-scale data pipelines with Python and PySpark.
• Build batch and near real-time processing on AWS data platforms.
• Design scalable data architectures and data lake solutions.
• Implement ETL/ELT workflows for ingesting, transforming, and publishing datasets.
• Collaborate with cross-functional teams and mentor junior engineers.

Skills

Python

PySpark

SQL

Data modelling

Analytics

Mentoring

Education

Bachelor's or Master's in CS/Engineering

Tools

AWS (EMR, Glue, Lambda, S3, Athena, Redshift)

OpenSearch/Elasticsearch

DynamoDB

Docker

Kubernetes

Airflow

Kafka/Kinesis

Terraform

Databricks

Job description

Nova Hunte Ltd is seeking a Senior Data Engineer to design, build and maintain scalable data pipelines using Python and PySpark in a remote, long-term contract with a London-based client.

You will work on AWS data services, data lakes, ETL/ELT, data modelling, and real-time processing, collaborate with product teams, mentor juniors, and ensure performance, security and observability across the data platform.