Senior Data Engineer: Databricks Lakehouse Migration

Visa Hunt; Poland; On-site; PLN 180,000 - 260,000; Full time

Job summary

Sigma Software is seeking a Senior Data Engineer to drive modern Lakehouse solutions and data migration efforts. You will join a team delivering scalable data platforms and modern governance practices in a complex, distributed environment.

The role involves collaborating with international teams to migrate BigQuery to Databricks, implementing Delta Lake, and optimizing Spark-based pipelines for high-volume retail analytics.

Qualifications

• Extensive experience with Databricks, PySpark, and large-scale data platforms.
• Strong Python and SQL skills; hands-on with cloud data processing.
• Experience migrating BigQuery to Databricks and lakehouse architectures.
• Experience with Delta Lake and medallion architecture.
• Experience with Airflow or similar orchestration.
• Proactive, cross-functional collaboration in international teams; English proficiency.

Responsibilities

• Participate in migration of large-scale analytics platform BigQuery -> Databricks.
• Design and implement scalable Lakehouse architectures using Databricks and Delta Lake.
• Develop and optimize data pipelines for large volumes of retail and analytical data.
• Implement data governance with Unity Catalog.
• Collaborate with Data Science, Analytics, Product, and Customer Engineering teams.
• Develop reusable data platform components and architecture guidelines.

Skills

Python

SQL

PySpark

Databricks

Apache Spark

Airflow

CI/CD

Cloud data platforms

English (Upper-Intermediate+)

Tools

Databricks

Delta Lake

Unity Catalog

BigQuery

Job description

Sigma Software is seeking a Senior Data Engineer to drive modern Lakehouse solutions and data migration efforts. You will join a team delivering scalable data platforms and modern governance practices in a complex, distributed environment.

The role involves collaborating with international teams to migrate BigQuery to Databricks, implementing Delta Lake, and optimizing Spark-based pipelines for high-volume retail analytics.