Senior Data Platform Engineer - Microsoft Fabric & Delta Lake

Software Mind; Województwo mazowieckie; Remote; PLN 180,000 - 320,000; Full time

Benefits offered by this job

Private healthcare

Life insurance

Multisport card

Language classes

Knowledge sharing

Job summary

Software Mind is seeking an experienced data engineer to join a project building a risk analysis platform on Microsoft Fabric. You will design and implement data pipelines, Delta Lake tables, and semantic models, collaborating with DevOps and senior engineers.

The role emphasizes autonomy, strong Python skills, and deep knowledge of Spark, Parquet, and SQL tuning for both Fabric and PostgreSQL workloads. Remote-friendly, international projects, and opportunities to travel.

Qualifications

• 5+ years of data engineering experience.
• 2+ years with Spark (PySpark preferred).
• Deep Delta Lake knowledge: log, retention, VACUUM, OPTIMIZE.
• Microsoft Fabric hands-on: workspaces, notebooks, lakehouses.

Responsibilities

• Design Bronze/Silver/Gold Delta schemas with optimized layout.
• Build Fabric Spark notebooks for feature pipelines.
• Create per-flavor Silver adapters and canonical MERGE DAGs.
• Develop Gold materialization for fact tables and scoring.
• Build Direct Lake semantic models; test performance.
• Configure OneLake namespaces and cross-workspace relationships.
• Implement idempotent Delta write patterns using delta-rs.
• Size Fabric capacity; assist Terraform IaC and REST bootstrap.
• Advise on ClickHouse contingency if latency is high.

Skills

PySpark

Python

Delta Lake

Microsoft Fabric

Parquet

SQL tuning

Pandas

PyArrow

Delta-rs

Data modeling

Tools

Terraform

Azure

ClickHouse

Job description

Software Mind is seeking an experienced data engineer to join a project building a risk analysis platform on Microsoft Fabric. You will design and implement data pipelines, Delta Lake tables, and semantic models, collaborating with DevOps and senior engineers.

The role emphasizes autonomy, strong Python skills, and deep knowledge of Spark, Parquet, and SQL tuning for both Fabric and PostgreSQL workloads. Remote-friendly, international projects, and opportunities to travel.