Data Engineer - £350PD - Remote

Tenth Revolution Group; Remote; GBP 60,000 - 80,000; Full time

Job summary

A leading technology recruitment firm is looking for a Data Engineer to work remotely. The role involves designing, building, and maintaining ETL/ELT pipelines using AWS technologies. Key requirements include hands-on experience with AWS Glue, data validation frameworks, and understanding of vector databases. This position offers competitive pay of £350 per day, making it an excellent opportunity for skilled individuals in data engineering.

Qualifications

• Experience in designing and maintaining ETL/ELT pipelines for various data types.
• Hands-on experience with AWS services for data processing and storage.
• Understanding of vector databases and embedding generation processes.

Skills

ETL/ELT pipelines development

AWS Glue

Data validation frameworks

Error handling strategies

Incremental data processing

Amazon S3 architectures

DynamoDB data modeling

Amazon Redshift querying

AWS Lambda orchestration

Vector databases understanding

Job description

Data Engineer - £350PD - Remote

Required Technical Skills

• Design, build, and maintain robust ETL/ELT pipelines for structured and unstructured data
• Hands‑on experience with AWS Glue and AWS Step Functions
• Implementation of data validation, data quality frameworks, and reconciliation checks
• Strong error handling, monitoring, and retry strategies in production pipelines
• Experience with incremental data processing patterns (CDC, watermarking, upserts)

AWS Data Services

• Amazon S3: data lake architectures, partitioning strategies, lifecycle policies
• DynamoDB: data modeling, secondary indexes, streams, and performance optimization
• Amazon Redshift: foundational querying, integrations, and performance considerations
• AWS Lambda for scalable data processing and orchestration
• Amazon EventBridge for event‑driven and decoupled data pipelines

Vector Databases & Embeddings

• Strong understanding of vector database concepts, indexing strategies, and performance trade‑offs
• Design and implementation of embedding generation pipelines
• Optimization techniques for semantic search and retrieval accuracy
• Effective ...