Data Engineer - Lakehouse on Azure (Fabric/Databricks)

Core Technology Systems Limited; Województwo pomorskie; Hybrid; PLN 150,000 - 210,000; Full time

Benefits offered by this job

Flexible remote

Office options London/Manc/Edinburgh/G

Gdańsk office

Private healthcare

Life assurance 5x salary

EAP

WFH allowance

Multisport card

Learning & development

Job summary

Core Technology Systems Limited seeks a Data Engineer to design, develop and deliver modern data platforms using Microsoft Fabric, Databricks and the Azure data ecosystem. You will work with stakeholders to translate requirements into scalable lakehouse architectures and drive incremental data processing.

This role requires strong English communication, collaboration with BI teams for Power BI reporting, and governance/CI/CD practices.

Qualifications

• : Proven experience designing and delivering enterprise-grade data pipelines and lakehouse architectures.
• _Strong understanding of medallion architecture and incremental/delta processing patterns.
• Hands-on experience with Microsoft Fabric (Data Factory, Lakehouse, Dataflows Gen2, Notebooks)-including Fabric capacity management.
• Hands-on experience with Databricks (notebooks, workflows, cluster configuration and resource management).
• Experience with Azure SQL, Azure Storage Accounts, Azure Key Vault, and building orchestration pipelines.
• Working knowledge of Power BI (semantic models, DAX, Power Query) as a distinct skill supporting the reporting layer.
• Solid grasp of data pipeline best practices: modular and metadata-driven design, version control, and CI/CD.

Responsibilities

• Lead the design and architecture of end-to-end data platforms using Microsoft Fabric and/or Databricks.
• Translate business requirements into scalable data models and lakehouse architectures, following medallion (bronze/silver/gold) design principles.
• Design and implement incremental data processing patterns to keep pipelines efficient and cost-effective at scale.
• Build and optimize data pipelines using Fabric components (Data Factory, Lakehouse, Dataflows Gen2, Notebooks) and/or Databricks (Workflows, Delta Live Tables, Notebooks).
• Manage compute resources responsibly - sizing and scaling Databricks clusters, and managing Fabric capacity - to balance performance and cost.
• Collaborate with BI developers and business analysts to ensure curated data supports accurate, trustworthy reporting, including in Power BI.
• Support presales activities including solution design, effort estimation, and client presentations.
• Establish and promote best practices in data governance, performance tuning, and DevOps/CI-CD for data platforms.

Skills

Data pipelines

Lakehouse architectures

Medallion architecture

Databricks

Microsoft Fabric

Power BI

CI/CD

Azure

Azure SQL

Tools

Data Factory

Delta Live Tables

Notebooks

Workflows

Databricks

Job description

Core Technology Systems Limited seeks a Data Engineer to design, develop and deliver modern data platforms using Microsoft Fabric, Databricks and the Azure data ecosystem. You will work with stakeholders to translate requirements into scalable lakehouse architectures and drive incremental data processing.

This role requires strong English communication, collaboration with BI teams for Power BI reporting, and governance/CI/CD practices.