Senior Data Engineer

Hack The Box; Warszawa; Vor Ort; PLN 60.000 - 90.000; Vollzeit

Benefits dieser Stelle

Private health care

Paid paternity leave

25 annual leave days

Free lunch & snacks at the office

Work-from-home flexibility

Dedicated budget for training and professional development

Zusammenfassung

Hack The Box seeks a data engineer to own and evolve data pipelines on GCP. You will design and build batch and streaming pipelines using tools like BigQuery and Pub/Sub, implement robust data quality measures, and collaborate with ML engineers. Required qualifications include strength in data modelling, SQL, and Python. Other benefits include private health care, paid leave, and flexible hybrid working options.

Qualifikationen

• Strong data modelling and warehouse architecture skills including dimensional modelling.
• Hands-on experience with GCP data services: BigQuery is a must, other tools are a plus.
• Production experience with streaming pipelines and good SQL and Python skills.

Aufgaben

• Design and build batch and streaming pipelines on Dataflow and BigQuery.
• Help drive the migration off legacy systems onto GCP-native stack.
• Own the orchestration layer in Airflow and improve data quality.

Kenntnisse

Data modelling and warehouse architecture skills

Hands-on experience with GCP data services

Production experience with streaming pipelines

Proficient in SQL

Strong Python skills

Workflow orchestration experience with Airflow

Familiarity with dbt or equivalent frameworks

Experience with Docker and Kubernetes

Tools

GCP

BigQuery

Kafka

Dataflow

ClickHouse

Jobbeschreibung

Role Overview

You will own and evolve our data pipelines on GCP—building new ones, hardening existing ones, improving data quality, and making clean, trustworthy data available across the organization. You'll work end-to-end on streaming and batch pipelines, from CDC and event ingestion through transformation, serving, and the feature layer that powers our ML and AI products.

Location & Work Mode

Preferably Greece. Fully Remote / Hybrid (2 days in the office, 3 days remote, plus one month of work from anywhere). If only in Greece: When hiring in Greece, we're open to candidates from all locations. Those based within 55 km of our Athens office will follow a hybrid work model. For candidates located beyond that radius, a fully remote arrangement is available.

Technology Tools

• Cloud & warehouse: GCP, BigQuery, Bigtable, Cloud Storage
• Streaming & messaging: Pub/Sub, Kafka
• Processing: Dataflow (Apache Beam), with Flink/Spark where appropriate
• Orchestration: Airflow (Cloud Composer)
• Analytical store: ClickHouse
• Languages: Python, SQL
• Modelling & quality: dbt, data quality gates
• Containers & CI/CD: Docker, Kubernetes, GitHub Actions / equivalent
• Legacy (being retired): Snowflake

Key Responsibilities

• Design and build batch and streaming pipelines on Dataflow, Pub/Sub, and Kafka feeding BigQuery, Bigtable, and ClickHouse
• Help drive the migration off Snowflake onto our GCP-native stack — and retire shadow pipelines along the way
• Own the orchestration layer in Airflow, including SLAs, retries, and data quality gates
• Model data for analytics and for ML — including feature pipelines that serve both training and low-latency online inference
• Partner with ML engineers on feature stores, drift monitoring, and retraining workflows
• Capture requirements from stakeholders and translate them into pragmatic, well-scoped data products
• Continuously improve data quality, reliability, observability, and cost efficiency
• Identify new data sources worth acquiring and integrate them cleanly

Qualifications & Experience

• Strong data modelling and warehouse architecture skills (dimensional modelling, event‑driven, lakehouse patterns)
• Hands‑on experience with GCP data services – BigQuery is a must; Pub/Sub, Dataflow, Bigtable, Cloud Composer are strong pluses
• Production experience with streaming pipelines on Dataflow/Beam, Flink, or Spark Structured Streaming, ingesting from Kafka and/or Pub/Sub
• Solid SQL and strong Python – you write production‑quality code, not just notebooks
• Experience with ClickHouse or another columnar OLAP engine in production
• Workflow orchestration experience with Airflow (or Prefect/Dagster)
• Comfortable with dbt or equivalent transformation frameworks
• Experience migrating off legacy warehouses (Snowflake, Redshift, Synapse) onto cloud‑native stacks is a plus
• Working knowledge of ML in production – feature engineering, feature stores, model deployment, drift monitoring, retraining
• Docker & Kubernetes experience
• CI/CD mindset, infrastructure‑as‑code sensibility, and a bias for simple, observable systems
• Bonus: CDC tooling (Datastream, Debezium), Vertex AI / Feature Store

Benefits

• Private health care
• Paid paternity leave
• 25 annual leave days
• Free lunch & snacks at the office
• 120€ Ticket Restaurant by Edenred
• Dedicated budget for training and professional development, participation in conferences
• Full access to the Hack The Box lab offerings; so you can learn how to hack
• State‑of‑the‑art equipment (Mac, iPhone, and mobile plan)
• Flexible WFH (Hybrid Model) – Fully Remote is also an option if you're not an Attica resident

Our benefits package is designed to provide strong support to our team, but it may vary depending on location and type of employment (e.g., UK, Greece, or engagement through an Employer of Record).

EEO Statement

At Hack The Box, we are committed to fostering a diverse, inclusive, and equitable workplace. We believe that diversity enriches our performance, services, and the communities we serve. As such, we ensure that all job applications are considered solely based on merit, skills, and qualifications. We do not discriminate on grounds of race, color, religion, gender, gender identity or expression, sexual orientation, national origin, genetics, disability, age, or veteran status. We are dedicated to providing a fair and respectful work environment that reflects our values.