Senior Data Platform Engineer – Microsoft Fabric (Remote)

Software Mind; Województwo mazowieckie; Remote; PLN 216,000 - 264,000; Full time

Benefits offered by this job

Flexible cooperation options

International projects

Private healthcare and life insurance

Multisport card

Language classes

Job summary

Software Mind is seeking an experienced Data Engineer to own end-to-end data pipelines on Microsoft Fabric, building Bronze/Silver/Gold Delta tables and feature pipelines. You will work on ingesting transactional data via secure channels, tokenizing sensitive data, and delivering optimized lakehouse models for analytics.

Strong PySpark, Delta Lake, and Python skills are essential, with autonomy to drive well-scoped features.

Qualifications

• 5+ years in data engineering with hands-on Spark development.
• Deep knowledge of Delta Lake internals and maintenance tasks.
• Parquet format expertise including footers, statistics, and encoding.
• Experience with Microsoft Fabric and Direct Lake / lakehouse models.
• Strong SQL performance tuning for Fabric and PostgreSQL.
• Proficient Python data engineering (pandas, PyArrow).
• Ability to communicate architecture clearly in writing.

Responsibilities

• Design and implement Bronze, Silver, and Gold Delta table schemas with PAN-safe layout.
• Build Fabric notebooks for feature pipelines across 24h/7d/30d windows.
• Create Silver adapters and per-flavor-version data handlers.
• Develop MERGE-based pipelines for Bronze to canonical Silver transitions.
• Materialize Gold tables and ensure correct score-source stamping.
• Build Direct Lake semantic models and optimize for reporting surfaces.
• Configure OneLake namespaces and cross-workspace lakehouse patterns.

Skills

Data engineering

Spark (PySpark)

Python (pandas, PyArrow)

Delta Lake

Tools

Microsoft Fabric

Direct Lake

OneLake

PySpark

ClickHouse

Terraform

Job description

Software Mind is seeking an experienced Data Engineer to own end-to-end data pipelines on Microsoft Fabric, building Bronze/Silver/Gold Delta tables and feature pipelines. You will work on ingesting transactional data via secure channels, tokenizing sensitive data, and delivering optimized lakehouse models for analytics.

Strong PySpark, Delta Lake, and Python skills are essential, with autonomy to drive well-scoped features.