Senior Data Engineer - Remote GCP Pipelines & ML Features

Hack The Box; Greater London; Hybrid; GBP 60,000 - 80,000; Full time

Benefits offered by this job

Private health care

Paid paternity leave

25 annual leave days

Free lunch & snacks at the office

Training budget and conference participation

State-of-the-art equipment

Flexible WFH (Hybrid Model)

Job summary

Hack The Box is seeking a skilled Data Engineer to own and evolve our data pipelines on GCP. You will design, build, and maintain both batch and streaming data pipelines, ensuring data quality and reliability across the organization.

Ideal candidates should have strong skills in data modelling, production experience with GCP services, and proficiency in SQL and Python. We offer a hybrid work model with options for remote work or relocation to our Athens Tech Hub, alongside a variety of benefits including private health care and training budgets.

Qualifications

• Strong data modelling and warehouse architecture skills.
• Hands-on experience with GCP data services, especially BigQuery.
• Production experience with streaming pipelines.

Responsibilities

• Design and build batch and streaming pipelines on GCP.
• Own the orchestration layer in Airflow.
• Model data for analytics and ML.

Skills

Strong data modelling skills

GCP data services

Production experience with streaming pipelines

Solid SQL

Solid Python

Docker and Kubernetes experience

Workflow orchestration with Airflow

Tools

Dataflow

Pub/Sub

ClickHouse

Flink

Spark Structured Streaming

Job description

Hack The Box is seeking a skilled Data Engineer to own and evolve our data pipelines on GCP. You will design, build, and maintain both batch and streaming data pipelines, ensuring data quality and reliability across the organization.

Ideal candidates should have strong skills in data modelling, production experience with GCP services, and proficiency in SQL and Python. We offer a hybrid work model with options for remote work or relocation to our Athens Tech Hub, alongside a variety of benefits including private health care and training budgets.