Senior Data Platform Engineer: Fabric & Delta Lake

Software Mind; United States; Remote; USD 110,000 - 170,000; Full time

Job summary

Software Mind is building a next-generation risk analysis platform on Microsoft Fabric, owning the medallion data architecture end-to-end. This role contributes by designing Delta tables and Direct Lake semantic models, building Spark pipelines and idempotent MERGE DAGs, and optimizing capacity, IaC, and performance to drive scalable analytics.

Ideal candidates will have 5+ years in data engineering, 2+ years in Spark/PySpark, and deep Delta Lake and Microsoft Fabric expertise, joining a company

Qualifications

• 5+ years data engineering experience.
• 2+ years Spark/PySpark experience.
• Deep Delta Lake and Microsoft Fabric expertise.

Responsibilities

• Design Bronze/Silver/Gold Delta tables and Direct Lake semantic models.
• Build Spark feature pipelines and idempotent MERGE DAGs.
• Optimize capacity, IaC, and performance.

Skills

Data engineering

Spark/PySpark

Delta Lake

Microsoft Fabric

Job description

Software Mind is building a next-generation risk analysis platform on Microsoft Fabric, owning the medallion data architecture end-to-end. This role contributes by designing Delta tables and Direct Lake semantic models, building Spark pipelines and idempotent MERGE DAGs, and optimizing capacity, IaC, and performance to drive scalable analytics.

Ideal candidates will have 5+ years in data engineering, 2+ years in Spark/PySpark, and deep Delta Lake and Microsoft Fabric expertise, joining a company