Remote Data Engineer: Fabric & Databricks Lakehouse Lead

Core Technology Systems Limited; Województwo pomorskie; Hybrid; PLN 180,000 - 280,000; Full time

Benefits offered by this job

Private healthcare

Monthly WFH allowance

Cycle-to-work (UK/Poland)

Job summary

Core Technology Systems Limited in Poland seeks a highly skilled Data Engineer to lead design and delivery of modern data platforms using Microsoft Fabric, Databricks, and the Azure data ecosystem. You will translate business needs into scalable lakehouse architectures and guide delivery teams.

The role requires strong medallion architecture knowledge, experience with streaming and incremental processing, and collaboration with BI to support Power BI reporting.

Qualifications

• Proven experience designing and delivering enterprise-grade data pipelines and lakehouse architectures.
• Strong understanding of medallion architecture and incremental/delta processing patterns.
• Hands-on experience with Microsoft Fabric (Data Factory, Lakehouse, Dataflows Gen2, Notebooks) including Fabric capacity management.
• Hands-on experience with Databricks (workflows, notebooks, cluster configuration and resource management).
• Experience with Azure SQL, Azure Storage Accounts, Azure Key Vault, and building orchestration pipelines.
• Working knowledge of Power BI (semantic models, DAX, Power Query).
• Solid grasp of data pipeline best practices: modular and metadata-driven design, version control, and CI/CD.

Responsibilities

• Lead the design and architecture of end-to-end data platforms using Microsoft Fabric and/or Databricks.
• Translate business requirements into scalable data models and lakehouse architectures, following medallion (bronze/silver/gold) design principles.
• Design and implement incremental data processing patterns to keep pipelines efficient and cost-effective at scale.
• Build and optimize data pipelines using Fabric components (Data Factory, Lakehouse, Dataflows Gen2, Notebooks) and/or Databricks (Workflows, Delta Live Tables, Notebooks).
• Manage compute resources responsibly - sizing and scaling Databricks clusters, and managing Fabric capacity - to balance performance and cost.
• Collaborate with BI developers and business analysts to ensure curated data supports accurate, trustworthy reporting, including in Power BI.
• Support presales activities including solution design, effort estimation, and client presentations.
• Establish and promote best practices in data governance, performance tuning, and DevOps/CI-CD for data platforms.

Skills

Data pipelines

Medallion architecture

Cloud data platforms

English communication

Tools

Microsoft Fabric

Databricks

Power BI

Azure SQL

Azure Data Factory

Azure Storage

Azure Key Vault

Job description

Core Technology Systems Limited in Poland seeks a highly skilled Data Engineer to lead design and delivery of modern data platforms using Microsoft Fabric, Databricks, and the Azure data ecosystem. You will translate business needs into scalable lakehouse architectures and guide delivery teams.

The role requires strong medallion architecture knowledge, experience with streaming and incremental processing, and collaboration with BI to support Power BI reporting.