Lakehouse Data Engineer - TB-scale Data, Kraków (Hybrid)

Commit; Warszawa; Hybrid; PLN 150,000 - 220,000; Full time

Job summary

Commit in Kraków, Poland seeks a Data Engineer who will own the company data lake—system of record for millions of financial events daily. You decide how data lands, is stored, retained and governed on S3, Snowflake and Databricks, ensuring accurate, reconciled data with zero drift from source.

You will build a robust lakehouse, enable streaming ingestion, optimize partitioning and query performance, and implement governance and retention to support analytics, finance and regulators.

Qualifications

• 3 years' experience in hands-on delivery within lakehouse architecture, pipelines and ingestion.
• Lakehouse architecture with bronze/silver/gold layers and open table formats (Iceberg/Delta/Hudi).
• Data layout & query optimization at TB+ scale; partitioning, compaction, file sizing, and query performance on Trino/Athena/Snowflake.

Responsibilities

• Own the lakehouse architecture and data tiers.
• Land operational data via CDC streaming (Kafka, Debezium) and handle late/duplicate events.
• Design data layouts for speed and cost; optimize partitioning and file sizing.

Skills

SQL

Lakehouse

CDC streaming

Data modeling

Snowflake

Databricks

Python

Airflow

Partitioning

Trino/Athena

Tools

Iceberg

Delta

Hudi

Kafka

Debezium

S3

GCS

Snowflake

Databricks

Athena

Job description

Commit in Kraków, Poland seeks a Data Engineer who will own the company data lake—system of record for millions of financial events daily. You decide how data lands, is stored, retained and governed on S3, Snowflake and Databricks, ensuring accurate, reconciled data with zero drift from source.

You will build a robust lakehouse, enable streaming ingestion, optimize partitioning and query performance, and implement governance and retention to support analytics, finance and regulators.