AWS Data Lakehouse Engineer

TESTQ Technologies; Basildon; On-site; GBP 90,000 - 130,000; Full time

Job summary

TESTQ Technologies is seeking a seasoned Data Lakehouse Engineer to design and optimize scalable lakehouse and data platform solutions. You will work across ingestion, processing, and storage layers to enable data-driven decision making while ensuring reliability and data quality across the ecosystem.

You will collaborate with cross-functional teams to implement governance, security, and performance enhancements, while leveraging modern data tooling and CI/CD practices.

Qualifications

• 7+ years in data engineering in a fast-paced, enterprise-scale environment.
• Bachelor's or Master's degree in Computer Science, Data Engineering or related field.
• Strong SQL and data integration platform skills (IBM Streamsets, Informatica).
• Extensive AWS experience (IAM, Lambda, EKS, S3, EMR, PySpark, MWAA, Lakehouse).
• Experience with Apache Iceberg and Snowflake performance tuning.
• Experience with batch pipelines and streaming technologies (StreamSets, Kafka).

Responsibilities

• Design and implement lakehouse integration architectures with ELT/ETL data flows.
• Build, optimize, and maintain scalable data pipelines for ingestion and storage.
• Implement data governance, security, lineage, and compliance practices.
• Monitor, troubleshoot and fine-tune data workflows and storage for performance.
• Provide production support with observability and proactive issue resolution.
• Collaborate with platform, analytics, and engineering teams on data modeling and storage optimization.
• Leverage Iceberg/Delta patterns for robust lakehouse design.

Skills

AWS Lambda

Data lakehouse

ETL concepts

SQL proficiency

Snowflake

StreamSets

Kafka

PySpark

MWAA

Iceberg

Education

Bachelor's or Master's in CS/Data Engineering

Tools

IBM Streamsets

Informatica

Kafka

Apache Iceberg

Job description

JD : https://www.tamis.cloud/job-description/dXNlcklEPTgzNzU5JnJvbGVJRD01OTQ3

Mandatory Skills : AWS Lambda, Data lakehouse Architecture, ETL Concepts

We are seeking a talented and experienced to join the Data Solutions domain in EMEA In this role you will design build

Data Lakehouse Engineer and optimize scalable lakehouse and data platform solutions that enable datadriven decision making across the organization You will collaborate closely with crossfunctional teams to create resilient ingestion and transformation pipelines while ensuring reliability performance and high

quality data across the ecosystem

Key Responsibilities

• Contribute to the design and implementation of lakehouse integration architectures including data flows process flows and ELTETL
• patterns
• Build optimize and maintain scalable data pipelines for ingestion processing and storage across data lake and lakehouse layers
• Implement and uphold data governance security lineage and compliance best practices throughout the data lifecycle
• Monitor troubleshoot and finetune data workflows compute jobs and storage layers to ensure high performance and reliability
• Provide production support ensuring robust system observability with proactive detection and resolution of issues
• Collaborate with platform analytics and engineering teams to ensure efficient data modeling table design and storage optimization eg
• IcebergDelta patterns

Technical Qualifications

• 7 years of experience in a data engineering or similar role within a fastpaced enterprisescale environment
• Bachelors or Masters degree in Computer Science Data Engineering or a related technical field
• Strong Proficiency in SQL and Data Integration Platforms such as IBM Streamsets or Informatica with thorough understanding of data
• transformation and orchestration processes
• Extensive Experience with AWS services including IAM Lambda EKS S3 Data Lake EMR PySpark MWAA and Lakehouse technologies
• Apache Iceberg
• Proven expertise with Snowflake including performance tuning and efficient query designExperience with batch pipelines eg
• StreamSets and streaming technologies eg Kafka

Nice to have

• Data Transformation Frameworks such as DBT
• Experience with both batch StreamSets and streaming Kafka data solutions
• Familiarity with data modelling concepts Inmon Kimball Data Vault etc
• Exposure to CICD or Infrastructureascode Terraform or any other is a plus
• Application Performance Monitoring Framework experience is a plus
• Knowledge of data quality and security best practices is advantageous
• Ability to understand complex architecture solutions and make sound estimates for the implementation

NonTechnical Skills

• Strong attention to detail with a proactive approach to identifying and resolving problems
• A genuine interest in emerging data technologies and a curiosity about continuous improvements
• Excellent verbal and written communication skills
• Attention to detail mindset proactively identify problems evaluate solutions
• Comfort working in an AIempowered automationdriven environment