Data Engineer - Hybrid

Aspire Personnel Ltd; City Of London; On-site; GBP 50,000 - 70,000; Full time

Job summary

A leading recruitment agency is seeking a Data Engineer with expertise in AWS cloud technologies for ETL pipeline development, data warehouse, and data lake design. Candidates must thrive in problem-solving oriented roles, have experience with Java, Python, and the AWS tech stack. This role involves collaboration in a fast-paced environment and offers hybrid working conditions.

Benefits

Health and lifestyle perks

25 days annual leave

Generous company pension scheme

Annual performance-based bonus

Company share ownership

Qualifications

• Experience in design and deployment of production data pipelines in a big data architecture.
• Proficient in extracting data using APIs and writing SQL queries.
• Experience in processing large amounts of structured and unstructured data on AWS.

Responsibilities

• Design and build for the AWS cloud.
• Collaborate with multiple stakeholders in a fast-paced environment.
• Engage in problem-solving with clients as well as on internal projects.

Skills

Problem-solving

Analytical thinking

Collaboration

Java

Python

Scala

Spark

SQL

Tools

AWS

EMR

Glue

RedShift

Kinesis

Lambda

DynamoDB

Job description

Overview

Our client teams operate globally from offices in the UK, Ireland, US, Nordics, and Netherlands. With diverse teams, they combine innovative thinking and breakthrough technologies to progress further, and faster. They work with clients in consumer and manufacturing, defence and security, energy and utilities, financial services, government and public services, health and life sciences, and transport. The Data Engineer will have experience in AWS cloud technologies for ETL pipeline, data warehouse and data lake design/building and data movement. You will join the business at a period of huge growth.

We also have openings in the following areas - Bristol, Manchester.

Tech stack

While the client is keen to use the right tech for the right task, you can expect to work with the following technologies to ensure scalable, high-performance applications:

• AWS is a significant growth area for the business with a diverse and growing capability, and we are looking for a Data Engineer with experience in AWS cloud technologies for ETL pipeline, data warehouse and data lake design/building and data movement.
• AWS data and analytics services (or open-source equivalent) such as EMR, Glue, RedShift, Kinesis, Lambda, DynamoDB.

What you can expect

• Work to agile best practices and cross-functionally with multiple teams and stakeholders. You\'ll be using your technical skills to problem solve with clients, as well as working on internal projects.
• Live in-person whiteboarding sessions to problem solve as a team, alongside asynchronous communication on Teams.
• Hybrid working with the team on client site or in the office a minimum of two days per week. However, the actual time you spend and where you spend it will vary by role or assignment, including up to 5 days per week on a client site.
• You\'ll work alongside colleagues from across the business - delivering transformative digital solutions to today\'s most complex business challenges.
• You\'ll be designing and building for the AWS cloud.

Essential requirements

• You thrive in problem-solving and analytical thinking.
• You enjoy collaborating with multiple stakeholders in a fast-paced environment.
• Experience in the design and deployment of production data pipelines from ingestion to consumption within a big data architecture, using Java, Python, Scala, Spark, SQL.
• Experience performing tasks such as writing scripts, extracting data using APIs, writing SQL queries etc.
• Experience in processing large amounts of structured and unstructured data, including integrating data from multiple sources through ingestion and curation functions on AWS cloud using AWS native or custom programming.

Benefits

• Health and lifestyle perks accompanying private healthcare for you and your family
• 25 days annual leave (plus a bonus half day on Christmas Eve) with the opportunity to buy 5 additional days
• Generous company pension scheme
• Opportunity to get involved with community and charity-based initiatives
• Annual performance-based bonus
• Company share ownership
• Tax efficient benefits (cycle to work, give as you earn)

PLEASE NOTE - ONLY CANDIDATES THAT HAVE DV CLEARANCE WILL BE CONSIDERED