Senior Data Platform Engineer (Lakehouse & Streaming) | Kraków, Poland

COMMIT Offshore; Kraków; In loco; PLN 220.000 - 320.000; Tempo pieno

Descrizione del lavoro

COMMIT Offshore in Kraków is seeking a Senior Data Platform Engineer to own the data lakehouse powering a gaming and financial platform serving 12M+ active users. You will design, implement, and operate data pipelines and governance across ingestion, storage, and analytics.

This hands-on role requires expertise with Iceberg/Delta, Snowflake, Databricks, Kafka, and batch/streaming data processing. You will optimize cost, enforce data quality and GDPR-compliant controls, and collaborate with

Competenze

• Experience designing and operating cloud data lakehouses at scale.
• Hands-on knowledge of Iceberg, Delta Lake, or Hudi.
• Production experience with Snowflake, Databricks, or BigQuery.
• Experience with Kafka, CDC, and streaming data pipelines.
• Strong SQL and data modeling skills.
• Experience optimizing TB+ data processing and governance.
• Familiarity with AWS S3 or Google Cloud Storage.
• Working knowledge of Python and orchestrators like Airflow or Dagster.

Mansioni

• Design and manage the data lakehouse architecture and governance.
• Build and maintain data pipelines with streaming/batch processing.
• Optimize storage, performance, and cloud costs across platforms.
• Ensure data accuracy, monitoring, and drift detection.
• Enforce data retention, security, and GDPR compliance.
• Collaborate with analytics, finance, and regulatory reporting teams.

Conoscenze

Cloud data lakehouse

Iceberg

Delta Lake

Hudi

Snowflake

Databricks

BigQuery

Kafka

CDC

SQL

Data modeling

TB-scale processing

Python

Airflow

Dagster

AWS S3

GCS storage

Strumenti

Snowflake

Databricks

BigQuery

Kafka

Airflow

Dagster

Iceberg

Delta Lake

Hudi

AWS S3

GCS Storage

Descrizione del lavoro

Senior Data Platform Engineer | Lakehouse & Streaming Data

We’re looking for an experienced Data Platform Engineer to build and own the data lakehouse for a large-scale gaming and financial platform serving 12M+ active users.

You’ll manage millions of daily transactions, including bets, wallet movements, and live odds, ensuring data is accurate, secure, and available for analytics, finance, and regulatory reporting.

This is a hands-on role with ownership of data architecture, ingestion, performance, and governance.

What You’ll Do

• Design and manage the data lakehouse using S3, Snowflake, or Databricks.
• Build and maintain data pipelines using Kafka, Debezium, and CDC.
• Implement Bronze, Silver, and Gold data layers using Iceberg or Delta.
• Optimize data storage, query performance, and cloud costs.
• Ensure data accuracy through monitoring, reconciliation, and drift detection.
• Manage data retention, security, access controls, and GDPR compliance.
• Monitor pipeline health and resolve data quality issues.

What We’re Looking For

• Strong experience designing and operating cloud data lakehouses.
• Hands-on knowledge of Iceberg, Delta Lake, or Hudi.
• Production experience with Snowflake, Databricks, or BigQuery.
• Experience with Kafka, CDC, and streaming data pipelines.
• Strong SQL and data modeling skills.
• Experience optimizing large-scale data processing (TB+).
• Understanding of data quality, reconciliation, and governance.
• Experience with AWS S3 or Google Cloud Storage.
• Working knowledge of Python and Airflow or Dagster.

Nice to Have

• Experience with financial transactions, wallets, ledgers, or gaming platforms.
• Knowledge of Trino, Athena, and advanced query optimization.

Interested in owning a mission-critical data platform at scale? We’d love to hear from you.

#Hiring #DataEngineering #DataPlatform #Snowflake #Databricks #Kafka #AWS #Lakehouse