Senior Data Engineer: Databricks Lakehouse Migration

Sigma Software; Kraków; On-site; PLN 240,000 - 360,000; Full time

Job summary

Sigma Software’s Data Engineering Center of Excellence seeks a Senior Data Engineer to migrate a large-scale analytics platform from BigQuery to Databricks. You will design scalable Lakehouse architectures, implement Delta Lake layers, and optimize PySpark data pipelines.

You will collaborate with international teams on governance, security, and platform modernization. The role focuses on large-scale data processing, cloud data platforms, and continuous learning within complex, enterprise-scale

Qualifications

• 5+ years of professional experience as a Data Engineer.

Responsibilities

• Participate in the migration of a large-scale analytical platform from BigQuery to Databricks.
• Design and implement scalable Lakehouse architectures using Databricks and Delta Lake.
• Analyze existing ETL / ELT workloads and define migration approaches.
• Develop and optimize data pipelines processing large volumes of retail and analytical data.
• Implement incremental processing strategies and scalable transformation frameworks.
• Build and maintain Spark-based data processing solutions using PySpark.
• Design and maintain medallion architecture layers including Bronze, Silver, and Gold.
• Implement data governance and security best practices using Unity Catalog.
• Collaborate with Data Science, Analytics, Product, and Customer Engineering teams.
• Participate in architecture discussions and technical solution design.
• Develop reusable data platform components and engineering standards.
• Conduct code reviews and contribute to platform reliability and maintainability.
• Troubleshoot and optimize complex SQL and Spark workloads.
• Support production deployments and platform modernization activities.

Skills

Python

SQL

PySpark

Databricks

Apache Spark

Delta Lake

Airflow

Unity Catalog

GCP/AWS/Azure

Tools

Databricks

Airflow

Delta Lake

Unity Catalog

BigQuery

Python

SQL

Job description

Sigma Software’s Data Engineering Center of Excellence seeks a Senior Data Engineer to migrate a large-scale analytics platform from BigQuery to Databricks. You will design scalable Lakehouse architectures, implement Delta Lake layers, and optimize PySpark data pipelines.

You will collaborate with international teams on governance, security, and platform modernization. The role focuses on large-scale data processing, cloud data platforms, and continuous learning within complex, enterprise-scale