Senior Data Platform Engineer — Microsoft Fabric (Remote)
Software Mind
Get a reply from this employer
Your resume and cover letter, tailored to exactly what they’re hiring for.
Benefits offered by this job
Job summary
Software Mind is hiring an experienced Data Engineer to own end-to-end data architecture on a Microsoft Fabric-based risk analysis platform. You will design Bronze/Silver/Gold Delta tables, build Fabric Spark pipelines, and optimize Direct Lake semantic models for scalable analytics.
The role requires 5+ years in data engineering with at least 2 years in Spark development, plus strong Delta Lake and Fabric expertise.
Qualifications
- 5+ years data engineering experience.
- 2+ years hands-on Spark development (PySpark preferred).
- Deep Delta Lake internals knowledge, including retention and VACUUM.
- Microsoft Fabric hands-on experience with lakehouses and semantic models.
- Strong Python data engineering skills (pandas, PyArrow).
Responsibilities
- Design and implement Bronze, Silver, and Gold Delta table schemas.
- Build Fabric Spark notebooks for feature pipelines and cross-merchant features.
- Create canonical MERGE DAGs for Bronze to canonical Silver data.
- Develop Direct Lake semantic models and optimize performance.
- Collaborate with DevOps on IaC and capacity provisioning.
Skills
Education
Tools
Job description
Software Mind is hiring an experienced Data Engineer to own end-to-end data architecture on a Microsoft Fabric-based risk analysis platform. You will design Bronze/Silver/Gold Delta tables, build Fabric Spark pipelines, and optimize Direct Lake semantic models for scalable analytics.
The role requires 5+ years in data engineering with at least 2 years in Spark development, plus strong Delta Lake and Fabric expertise.
'/%3e%3cpath%20d='M101.744%2012.4726L102.894%2016.1947L99.0021%2013.2201L101.744%2012.4726ZM105.3%208.40937H100.488L99.0026%203.59473L97.5116%208.41047L92.7%208.40385L96.5965%2011.3834L95.1055%2016.1942L99.0021%2013.2196L101.408%2011.3834L105.3%208.40992V8.40937Z'%20fill='white'/%3e%3cdefs%3e%3clinearGradient%20id='paint0_linear_5593_1381'%20x1='90'%20y1='9.44471'%20x2='99'%20y2='9.44471'%20gradientUnits='userSpaceOnUse'%3e%3cstop%20stop-color='%2300AD70'/%3e%3cstop%20offset='0.998594'%20stop-color='%2300B67A'/%3e%3cstop%20offset='1'%20stop-color='%23DCDCE6'/%3e%3c/linearGradient%3e%3c/defs%3e%3c/svg%3e){kind=small}
