Data Engineer (Lakehouse)

COMMIT Offshore; Województwo małopolskie; Hybrid; PLN 260,000 - 380,000; Full time

Job summary

COMMIT Offshore is seeking a Senior Data Lakehouse Engineer in Kraków to own the architecture and evolution of the data platform supporting millions of events. You will shape ingestion, storage, retention, governance, and reconciliation across S3, Snowflake and Databricks, enabling analytics, finance and regulatory teams to work with accurate data.

The role is hybrid, based in Kraków with 2 days per week in the office; fully remote candidates are not considered.

Qualifications

• 5+ years of experience in data engineering.
• Experience designing and owning lakehouse architectures.
• Hands-on experience with Apache Iceberg, Delta Lake, or Hudi.
• Strong knowledge of S3, Snowflake, Databricks, Trino, or Athena.
• Experience with CDC, Kafka, streaming pipelines, and schema evolution.
• Understanding of immutability/WORM retention, governance, and regulatory data requirements.

Responsibilities

• Own and evolve the lakehouse architecture, including bronze/silver/gold layers.
• Define data layout, partitioning, compaction, file sizing, and query optimization at TB+ scale.
• Design reliable CDC and streaming ingestion using Kafka and Debezium.
• Manage schema evolution and handle late, duplicate, and out-of-order events.
• Own retention, archival, immutability/WORM, and regulatory data requirements.
• Ensure data correctness through reconciliation, freshness SLAs, and drift detection.
• Define governance standards including lineage, access control, PII masking, encryption, and audit trails.
• Monitor ingestion health, platform performance, and cloud storage/compute costs.

Skills

Data engineering

Lakehouse architecture

Kafka

Streaming pipelines

Data governance

Tools

Apache Iceberg

Delta Lake

Hudi

S3

Snowflake

Databricks

Trino

Athena

Job description

The company is looking for a Senior Data Lakehouse Engineer to own the architecture and evolution of the data platform behind millions of financial events across 12M+ active users.

You’ll be responsible for how data is ingested, stored, retained, governed, and reconciled across S3 and Snowflake/Databricks, ensuring analytics, finance, and regulatory teams work with accurate and consistent data.

Responsibilities

• Own and evolve the lakehouse architecture, including bronze/silver/gold layers.
• Define data layout, partitioning, compaction, file sizing, and query optimization at TB+ scale.
• Design reliable CDC and streaming ingestion using Kafka and Debezium.
• Manage schema evolution and handle late, duplicate, and out-of-order events.
• Own retention, archival, immutability/WORM, and regulatory data requirements.
• Ensure data correctness through reconciliation, freshness SLAs, and drift detection.
• Define governance standards including lineage, access control, PII masking, encryption, and audit trails.
• Monitor ingestion health, platform performance, and cloud storage/compute costs.

Requirements

• 5+ years of experience in data engineering.
• Strong experience designing and owning lakehouse architectures.
• Hands‑on experience with Apache Iceberg, Delta Lake, or Hudi.
• Strong knowledge of S3, Snowflake, Databricks, Trino, or Athena.
• Experience optimizing large‑scale data platforms through partitioning, compaction, and storage design.
• Experience with CDC, Kafka, streaming pipelines, and schema evolution.
• Understanding of immutability/WORM retention, governance, and regulatory data requirements.
• Experience with financial, wallet, ledger, iGaming, fintech, or other audit‑heavy data is a strong advantage.

Please note: This is a hybrid role based in Kraków, requiring 2 days per week in the office. Fully remote candidates cannot be considered.