AWS Data Engineer

Tenth Revolution Group; City Of London; Hybrid; GBP 52,000 - 60,000; Full time

Job summary

Tenth Revolution Group is seeking an experienced AWS Data Engineer for an initial 6‑month contract. You will design, build and optimise modern data platforms and pipelines to enable analytics, reporting and AI initiatives across the business.

Key tech includes Python, PySpark, dbt, Airflow, Redshift, Iceberg and OpenSearch. You will work with Knowledge Graphs and CircleCI for CI/CD, collaborating with Analysts and product teams to deliver scalable data solutions.

Qualifications

• Strong commercial AWS data engineering experience.
• Proficiency in Python, SQL and PySpark.
• Hands-on experience with dbt and Apache Airflow.
• Experience with Amazon Redshift and Iceberg lakehouse architectures.
• Knowledge of OpenSearch and graph-based data modelling.
• CI/CD pipelines using CircleCI.
• Strong data modelling, performance tuning and engineering best practices.

Responsibilities

• Design and develop scalable ETL/ELT data pipelines using Python and PySpark.
• Build data transformation frameworks with dbt.
• Develop and orchestrate workflows with Apache Airflow.
• Deliver high‑performance data warehouse solutions within Amazon Redshift.
• Support the implementation and optimisation of Apache Iceberg lakehouse architectures.
• Develop and enhance search capabilities using OpenSearch.
• Work with Knowledge Graph technologies to improve data discovery and relationships.
• Implement CI/CD best practices using CircleCI.
• Collaborate with Data Analysts, Product Teams, and Business Stakeholders to deliver high‑quality data solutions.
• Ensure data quality, reliability, governance, and scalability across the platform.

Skills

Python

SQL

PySpark

Data modeling

OpenSearch

Knowledge Graphs

dbt

Apache Airflow

CircleCI

Redshift

Tools

dbt

Apache Airflow

CircleCI

OpenSearch

Amazon Redshift

Apache Iceberg

PySpark

Job description

AWS Data Engineer

Contract: 6 Months
Rate: £400 per day
IR35 Status: Outside IR35
Location: Remote / Hybrid

Overview

We are seeking an experienced AWS Data Engineer to join a growing consultancy on an initial 6-month contract. You'll be responsible for designing, building, and optimising modern data platforms and pipelines, enabling analytics, reporting, and AI-driven initiatives across the business.

This role is ideal for someone with strong AWS experience and a background working with modern data tooling including dbt, PySpark, Airflow, Redshift, Iceberg, OpenSearch, Knowledge Graphs, Python, and CircleCI.

Key Responsibilities

• Design and develop scalable ETL/ELT data pipelines using Python and PySpark
• Build and maintain data transformation frameworks using dbt
• Develop and orchestrate workflows using Apache Airflow
• Deliver high-performance data warehouse solutions within Amazon Redshift
• Support the implementation and optimisation of Apache Iceberg lakehouse architectures
• Develop and enhance search capabilities using OpenSearch
• Work with Knowledge Graph technologies to improve data discovery and relationships
• Implement CI/CD best practices using CircleCI
• Collaborate with Data Analysts, Product Teams, and Business Stakeholders to deliver high-quality data solutions
• Ensure data quality, reliability, governance, and scalability across the platform

Required Experience

• Strong commercial experience as a Data Engineer within AWS
• Expertise in Python, SQL, and PySpark
• Hands‑on experience with dbt
• Strong experience managing workflows with Apache Airflow
• Experience with Amazon Redshift
• Knowledge of modern data lakehouse architectures, including Apache Iceberg
• Experience with OpenSearch / Elasticsearch technologies
• Exposure to Knowledge Graphs and graph-based data modelling
• Experience implementing CI/CD pipelines using CircleCI
• Strong understanding of data modelling, performance optimisation, and engineering best practices

Desirable

• Experience with AWS services such as S3, Lambda, Glue, ECS, EKS, or EMR
• Experience supporting AI, machine learning, or advanced analytics use cases
• Infrastructure as Code experience (Terraform preferred)
• Experience working within Agile delivery environments