Senior Data Engineer - Scalable Cloud Pipelines Lead

Bettyjobboard; Greater London; On-site; GBP 70,000 - 100,000; Full time

Benefits offered by this job

Competitive salary

Premium Health insurance

Career and skills development

Fun and collaborative team environment

New modern office space

Job summary

Betty is hiring a Data Warehouse Engineer to design and optimize scalable data pipelines in a London office. You will collaborate with Engineering and business stakeholders to translate data needs into robust ETL/ELT solutions and ensure compliant reporting.

Requirements include 3+ years in data warehousing, Python/SQL proficiency, and experience with cloud DWs such as Redshift, Snowflake or BigQuery. Strong communication and teamwork are essential.

Qualifications

• Bachelor's degree in Computer Science, Data Science, or a related field.
• 3+ years in data warehouse engineering or a related role.
• Experience with cloud data warehousing technologies (Redshift/Snowflake/BigQuery).
• Strong Python and SQL skills; knowledge of data modelling and ETL/ELT design.
• Experience with Airflow or Dagster; understanding of CI/CD pipelines.
• Excellent analytical, problem solving and communication abilities.

Responsibilities

• Collaborate with cross functional teams to define data requirements.
• Develop and maintain scalable data pipelines loading data into the DWH.
• Optimize existing data processes for performance and reliability.
• Work with infrastructure teams to implement scalable and secure data platforms.
• Create and maintain reports for regulatory and internal needs.
• Evaluate and adopt new technologies to improve data processing capacity.
• Mentor junior colleagues on data engineering best practices.

Skills

Python

SQL

Airflow

Dagster

CI/CD

Data modeling

Communication

Teamwork

Education

Bachelor's degree in Computer Science or Data Science

Tools

Amazon Redshift

Snowflake

Google BigQuery

Docker

Kubernetes

Job description

Betty is hiring a Data Warehouse Engineer to design and optimize scalable data pipelines in a London office. You will collaborate with Engineering and business stakeholders to translate data needs into robust ETL/ELT solutions and ensure compliant reporting.

Requirements include 3+ years in data warehousing, Python/SQL proficiency, and experience with cloud DWs such as Redshift, Snowflake or BigQuery. Strong communication and teamwork are essential.