Data Engineer Python Spark ETL

Client Server; London; Hybrid; GBP 75,000 - 90,000; Full time

Job summary

A leading Cyber Security Risk Management tech company is looking for a Data Engineer with strong Python and Spark skills to build a Data Lake and enhance data infrastructure. This hybrid position allows for significant impact on data-driven decisions and optimal systems development due to the company's rapid growth.

Benefits

Private Medical Healthcare including Dental and Vision cover

Qualifications

• Experienced Data Engineer with strong knowledge of Data Lakes and ETL processes.
• Strong skills in Python and SQL required.
• Experience with big data frameworks, particularly Spark, is essential.

Responsibilities

• Build and scale the data infrastructure for analytics capabilities.
• Create a new Data Lake from scratch using modern tools.
• Drive optimisations and develop new capabilities for data sets.

Skills

Python

SQL

Data Lakes

Data Warehousing

ETL / ELT processes

Data pipeline orchestration

Analytical skills

Problem solving

Critical thinking

Communication skills

Tools

Spark

AWS services (S3, Redshift, EMR, Glue)

Job description

Social network you want to login/join with:

Data Engineer (Python Spark ETL) London / WFH to £90k

Are you a tech savvy Data Engineer keen to make an impact, delivering Greenfield systems?

You could be progressing your career at a successful and growing Cyber Security Risk Management tech company that specialises in solutions for SME's, working on complex and interesting systems at the cutting edge of technology. The company is scaling and enjoying great success.

As a Data Engineer you'll be instrumental in building and scaling the data infrastructure to support advanced data aggregation, storage and analytics capabilities as the company enters a phase of data maturity, holding data from hundreds of thousands of organisations since they were established seven years ago. You'll take ownership of building a new Data Lake from scratch using a range of modern tools and technologies, primarily Python and Spark in an AWS environment.

This is an impactful role where you'll be at the heart of the technology function to drive optimisations and develop new capabilities that maximise the value of the company's accumulated data sets.

Location / WFH:
There's a hybrid work from home policy with three days in the London office per week.

About you:

• You are an experienced Data Engineer with a strong knowledge of Data Lakes, Data Warehousing, ETL / ELT processes and data pipeline orchestration
• You have strong Python and SQL coding skills
• You have experience with big data frameworks and tools including Spark
• You have a good knowledge of AWS data services (e.g. S3, Redshift, EMR, Glue)
• You have strong analytical, problem solving and critical thinking skills
• You have excellent communication skills and experience of working across teams

What's in it for you:
As a Data Engineer (Python Spark ETL) you will earn a competitive salary plus benefits including:

• Salary to £90k
• Private Medical Healthcare including Dental and Vision cover