Senior Data Engineer

Thrive Learning Limited; Greater London; Remote; GBP 60,000 - 90,000; Full time

Job summary

A leading technology firm is looking for a Senior Data Engineer to join its growing team. You will design, build, and optimize data pipelines while ensuring data accuracy and integrity. This role offers flexibility, a competitive salary, and a unique benefits package, including unlimited holiday and opportunities for remote work.

Benefits

Competitive salary

Flexible working hours

Birthday off

Health cash plan

Unlimited Holiday

Work from anywhere (4 weeks a year)

Thrive days! 10-3 Fridays

Shutdown over Christmas & New Year

Company ski trip

Qualifications

• Substantial experience in large-scale data environments.
• Strong understanding of ETL/ELT processes.
• Experience with streaming platforms.

Responsibilities

• Design and maintain scalable data pipelines and ELT/ETL processes.
• Collaborate with teams to deliver data solutions.
• Monitor and troubleshoot data systems.

Skills

Data Engineering

Python

TypeScript

SQL

NoSQL

Data Warehousing

ETL/ELT

Apache Airflow

DBT

Data Visualization

Tools

Snowflake

Apache Kafka

Amazon Kinesis

Git

Job description

About the Role

We are searching for a seasoned Senior Data Engineer to join our expanding data team. In this role, you'll focus on building, optimizing, and maintaining reliable data pipelines and large-scale data processing systems. You'll play a vital role in advancing our data infrastructure to support business requirements and drive insightful decision-making.

Our Senior Data Engineer will be pivotal in shaping our data architecture and will work closely with stakeholders across Product, Engineering, and Analytics to deliver on ambitious projects. This is an exceptional opportunity to leverage your deep technical expertise in a dynamic, fast-paced environment.

Key Responsibilities

• Design, build, and maintain scalable data pipelines and ELT/ETL processes using cutting-edge tools and technologies.
• Collaborate with cross-functional teams to define and deliver data solutions that enhance business insights.
• Develop and manage large datasets and ensure data integrity, accuracy, and accessibility.
• Optimise data processing workflows for efficiency and performance.
• Monitor and troubleshoot data pipelines and systems, resolving any issues promptly to maintain reliability.
• Implement best practices for data security, privacy, and compliance.

Essential Skills

• Substantial experience in data engineering roles, particularly with large-scale data environments.
• Proficiency in programming languages such as Python and TypeScript
• Strong experience with data warehousing solutions, such as Snowflake or similar
• Expert knowledge of ETL/ELT tools like Apache Airflow, DBT, or similar.
• Deep understanding of SQL and NoSQL databases, such as Snowflake, MongoDB, or similar.
• Experience with streaming platforms like Apache Kafka or Amazon Kinesis.
• Strong problem-solving skills with a detail-oriented approach to engineering challenges.
• Effective communication skills, with the ability to convey complex technical concepts to diverse audiences.

Desirable Skills

• Familiarity with data visualisation tools and techniques.
• Experience with agile methodologies and a DevOps mindset.
• Proficiency in version control systems (e.g., Git)

What you'll get

Competitive salary
Flexible working hours
Birthday off
???? Health cash plan
Unlimited Holiday. Yes, you did hear that right!
Work from anywhere (4 weeks a year)
Thrive days! 10-3 Fridays
Shutdown over Christmas & New Year!
️ Company ski trip

#LI-Remote