Senior Data Engineer — Remote: GCP Pipelines & ML

Hack The Box; Województwo mazowieckie; Hybrid; PLN 60,000 - 90,000; Full time

Benefits offered by this job

Private health care

Paid paternity leave

25 annual leave days

Free lunch & snacks at the office

Work-from-home flexibility

Dedicated budget for training and professional development

Job summary

Hack The Box seeks a data engineer to own and evolve data pipelines on GCP. You will design and build batch and streaming pipelines using tools like BigQuery and Pub/Sub, implement robust data quality measures, and collaborate with ML engineers. Required qualifications include strength in data modelling, SQL, and Python. Other benefits include private health care, paid leave, and flexible hybrid working options.

Qualifications

• Strong data modelling and warehouse architecture skills including dimensional modelling.
• Hands-on experience with GCP data services: BigQuery is a must, other tools are a plus.
• Production experience with streaming pipelines and good SQL and Python skills.

Responsibilities

• Design and build batch and streaming pipelines on Dataflow and BigQuery.
• Help drive the migration off legacy systems onto GCP-native stack.
• Own the orchestration layer in Airflow and improve data quality.

Skills

Data modelling and warehouse architecture skills

Hands-on experience with GCP data services

Production experience with streaming pipelines

Proficient in SQL

Strong Python skills

Workflow orchestration experience with Airflow

Familiarity with dbt or equivalent frameworks

Experience with Docker and Kubernetes

Tools

GCP

BigQuery

Kafka

Dataflow

ClickHouse

Job description

Hack The Box seeks a data engineer to own and evolve data pipelines on GCP. You will design and build batch and streaming pipelines using tools like BigQuery and Pub/Sub, implement robust data quality measures, and collaborate with ML engineers. Required qualifications include strength in data modelling, SQL, and Python. Other benefits include private health care, paid leave, and flexible hybrid working options.