AWS Data Engineer

Tempting Ventures; London; Remote; GBP 100,000 - 125,000; Full time

Job summary

A leading global technology firm in London is seeking a Data Engineer to work primarily with AWS data technologies. The position involves designing, building, and supporting solutions for Business Intelligence and Data Science efforts. The ideal candidate will have over 3 years of experience with cloud data warehousing tools and programming skills in multiple languages. This role offers a contract duration of 6 months with remote work options and an attractive pay rate.

Qualifications

• Over 3 years experience with Spark for batch and stream processing.
• Over 3 years experience with cloud data warehousing tools.
• Strong understanding of AWS security.

Responsibilities

• Collaborate with data consumers to identify data solution requirements.
• Design and support solutions for Business Intelligence in AWS.
• Provision and maintain AWS services and infrastructure as code.

Skills

Spark for batch and stream processing

Cloud data warehousing tools (Snowflake, Redshift, BigQuery, ClickHouse)

SQL (especially HiveQL)

Programming skills in Java, Scala, Python, Typescript

AWS security (S3, Kinesis, EMR, Glue, LakeFormation)

Experience with GitHub, DataDog, and AWS tools

Job description

Overview

The Data Engineer will work with the product engineering team, focusing on enabling Business Intelligence and Data Science efforts, primarily on AWS-based data technologies. The engineer will also collaborate with the corporate technology team to build, manage, automate, and support AWS infrastructure.

Client

My client is a major global developer and operator of luxury casino resorts, known for iconic properties in Las Vegas, Macau, and Singapore.

Responsibilities

• Collaborate with data consumers, producers, and compliance specialists to identify data solution requirements for executive exposure.
• Design, build, operate, and support solutions for Business Intelligence and Data Science in AWS, including data ingestion, ETL/ELT processes, curated data products, and third-party integrations.
• Support and evolve data lake, catalog, warehouse, and processing infrastructure.
• Provision and maintain AWS services and infrastructure as code using Amazon CDK.
• Recommend product/vendor choices and design strategies.
• Identify opportunities to reduce waste and redundancy.
• Manage work requests to meet service objectives and KPIs.
• Handle incident, problem, and change management processes.

Skills & Experience

• Over 3 years experience with Spark for batch and stream processing; Ray experience is a plus.
• Over 3 years experience with cloud data warehousing tools like Snowflake, Redshift, BigQuery, or ClickHouse.
• Proficiency in SQL, especially HiveQL.
• Programming skills in Java, Scala, Python, and Typescript.
• Strong understanding of AWS security, especially related to S3, Kinesis, EMR, Glue, LakeFormation.
• Experience with GitHub, DataDog, and AWS tools.

Contract Details

• Duration: 6 months initially
• Rate: £600 per day
• Location: Remote (ad hoc London travel expensed)
• Outside IR35
• Start: ASAP