Data Lakehouse Engineer

N Consulting Limited; Basildon; Hybrid; GBP 60,000 - 80,000; Full time

Job summary

N Consulting Limited is seeking a highly skilled Data Lakehouse Engineer for a hybrid contract role based in Basildon, UK. The successful candidate will design and implement modern data lakehouse architectures, ensuring high performance and scalability.

Key responsibilities include developing data pipelines using Python and PySpark, working with AWS services, and implementing CI/CD pipelines. Strong experience in AWS Data Engineering and knowledge of data quality frameworks are essential.

Qualifications

• Strong experience in AWS Data Engineering.
• Hands-on expertise with AWS services and Apache Iceberg.
• Solid understanding of data lakehouse architecture principles.

Responsibilities

• Design and implement scalable AWS Data Lakehouse solutions.
• Develop and maintain data pipelines using Python and PySpark.
• Collaborate with cross-functional teams including data analysts and DevOps engineers.

Skills

AWS Data Engineering

Python

PySpark

Apache Iceberg

Terraform

CI/CD

Tools

AWS S3

AWS EMR

AWS Lambda

AWS EKS

MWAA

Job description

# Data Lakehouse Engineer at N Consulting LtdJob Title: Data Lakehouse Engineer Work Type: Hybrid | Contract Locations: Basildon(UK) or Nenagh / Dublin (Ireland) or Warsaw (Poland)Role OverviewWe are seeking a highly skilled Data Lakehouse Engineer to join our team on a hybrid contract basis. This role focuses on designing, building, and optimizing modern data lakehouse architectures using AWS-native services and open table formats like Apache Iceberg. You will play a key role in enabling scalable, secure, and high-performance data platforms.Key Responsibilities Design and implement scalable AWS Data Lakehouse solutions Develop and maintain data pipelines using Python and PySpark Work with AWS services including: S3, EMR, Lambda, IAM, EKS, MWAA Build and manage Apache Iceberg tables for efficient data storage and querying Implement CI/CD pipelines for data platform deployments Use Terraform for infrastructure as code (IaC) Ensure data quality, governance, and security best practices Orchestrate workflows and automate data processes Collaborate with cross-functional teams including data analysts, scientists, and DevOps engineersRequired Skills & Experience Strong experience in AWS Data Engineering Hands-on expertise with: AWS services: IAM, Lambda, EKS, S3, EMR, MWAA Apache Iceberg Python & PySpark Solid understanding of data lakehouse architecture principles Experience with CI/CD pipelines and Terraform Knowledge of data quality frameworks and data security standards Familiarity with workflow orchestration toolsPreferred Qualifications Experience working in hybrid cloud or multi-region environments Strong problem-solving and communication skills Ability to work independently in a contract setting