AWS Data Engineer

PURVIEW; Basildon; On-site; GBP 65,000 - 100,000; Full time

Job summary

PURVIEW in Basildon, UK is seeking an experienced Data Lakehouse Engineer to design and optimize scalable Lakehouse and data platform solutions. You will build ingestion and transformation pipelines to enable data-driven decision-making across the organization.

The role requires strong AWS Lambda, data lakehouse architecture and ETL concepts, plus hands-on experience with Snowflake, Kafka, and StreamSets. You will collaborate with cross-functional teams to ensure data quality, governance, and

Qualifications

• 7 years of experience in a data engineering or similar role within a fast paced enterprise scale environment
• Bachelor's or Master's degree in Computer Science, Data Engineering, or related technical field
• Strong proficiency in SQL and data integration platforms with understanding of data transformation and orchestration processes
• Extensive experience with AWS services including IAM, Lambda, EKS, S3, EMR, PySpark, MWAA, and Lakehouse technologies such as Apache Iceberg
• Proven expertise with Snowflake including performance tuning and efficient query design; experience with batch (StreamSets) and streaming (Kafka) environments

Responsibilities

• Contribute to the design and implementation of Lakehouse integration architectures including data flows, process flows, and ELT/ETL patterns
• Build, optimize and maintain scalable data pipelines for ingestion, processing, and storage across data lake and Lakehouse layers
• Implement and uphold data governance, security, lineage and compliance best practices throughout the data lifecycle
• Monitor, troubleshoot and finetune data workflows, compute jobs and storage layers to ensure high performance and reliability
• Provide production support ensuring robust system observability with proactive detection and resolution of issues
• Collaborate with platform, analytics and engineering teams to ensure efficient data modeling, table design and storage optimization (e.g., Iceberg, Delta patterns)

Skills

AWS Lambda

Datalake house Architecture

ETL Concepts

Education

Bachelor's or Master's degree in Computer Science/Data Engineering or related field

Tools

IBM Streamsets

Informatica

Snowflake

Kafka

Job description

Location-Basildon, UK -5 days from Office

JD:

Mandatory Skills :

AWS Lambda, Datalake house Architecture, ETL Concepts

Overview

• We are seeking a talented and experienced to join the Data Solutions domain in EMEA In this role you will design build
• Data Lakehouse Engineer and optimize scalable Lakehouse and data platform solutions that enable data driven decision-making across the organization.
• You will collaborate closely with cross functional teams to create resilient ingestion and transformation pipelines while ensuring reliability performance and highquality data across the ecosystem

Key Responsibilities

• Contribute to the design and implementation of Lakehouse integration architectures including data flows process flows and ELT/ETL patterns
• Build optimize and maintain scalable data pipelines for ingestion processing and storage across data lake and Lakehouse layers
• Implement and uphold data governance security lineage and compliance best practices throughout the data lifecycle
• Monitor troubleshoot and finetune data workflows compute jobs and storage layers to ensure high performance and reliability
• Provide production support ensuring robust system observability with proactive detection and resolution of issues
• Collaborate with platform analytics and engineering teams to ensure efficient data modeling table design and storage optimization eg Iceberg Delta patterns

Technical Qualifications

• 7 years of experience in a data engineering or similar role within a fast paced enterprise scale environment
• Bachelors or Masters degree in Computer Science Data Engineering or a related technical field
• Strong Proficiency in SQL and Data Integration Platforms such as IBM Streamsets or Informatica with thorough understanding of data transformation and orchestration processes
• Extensive Experience with AWS services including IAM Lambda EKS S3 Data Lake EMR PySpark MWAA and Lakehouse technologies, Apache Iceberg
• Proven expertise with Snowflake including performance tuning and efficient query design Experience with batch pipelines eg StreamSets and streaming technologies eg Kafka

Nice to have

• Data Transformation Frameworks such as DBT
• Experience with both batch StreamSets and streaming Kafka data solutions
• Familiarity with data modelling concepts Inmon Kimball Data Vault etc
• Exposure to CICD or Infrastructure a scode Terraform or any other is a plus
• Application Performance Monitoring Framework experience is a plus
• Knowledge of data quality and security best practices is advantageous
• Ability to understand complex architecture solutions and make sound estimates for the implementation

Non Technical Skills

• Strong attention to detail with a proactive approach to identifying and resolving problems
• A genuine interest in emerging data technologies and a curiosity about continuous improvements
• Excellent verbal and written communication skills
• Attention to detail mindset proactively identify problems evaluate solutions
• Comfort working in an AI empowered automation driven environment

Skills

Mandatory Skills :

AWS Lambda, Data lakehouse Architecture, ETL Concepts