Senior Data Engineer - Microsoft Fabric & PySpark (Remote)

xdesign; United States; Hybrid; USD 100,000 - 150,000; Full time

Benefits offered by this job

Flexible working

Hybrid/Remote options

Job summary

CreateFuture is an AI-native consulting partner that builds data products and digital solutions for major clients. We are seeking a Data Engineer to design, implement, and maintain production-grade data pipelines using Microsoft Fabric, Python, and PySpark.

You’ll collaborate with engineers and stakeholders across the business to deliver reliable, high-performance data infrastructure. You will contribute to a culture of craft and growth, with flexible working options including hybrid and remote

Qualifications

• Hands-on experience with Microsoft Fabric.
• Strong proficiency in Python.
• Experience with PySpark.
• Proven experience working effectively as part of a team.
• Experience delivering production-ready data pipelines, including CI/CD management and support.

Responsibilities

• Design, build, and maintain scalable data pipelines using Microsoft Fabric, Python, and PySpark
• Deliver production-ready data solutions, ensuring reliability, performance, and maintainability
• Support and manage CI/CD pipelines for data engineering workflows
• Collaborate closely with team members, sharing knowledge and contributing to a strong engineering culture
• Troubleshoot and resolve issues in live data pipelines
• Partner with cross-functional teams to understand data requirements and translate them into technical solutions

Skills

Microsoft Fabric

Python

PySpark

Team collaboration

CI/CD for data pipelines

Tools

Azure OneLake

Azure DevOps

Azure ML

Job description

CreateFuture is an AI-native consulting partner that builds data products and digital solutions for major clients. We are seeking a Data Engineer to design, implement, and maintain production-grade data pipelines using Microsoft Fabric, Python, and PySpark.

You’ll collaborate with engineers and stakeholders across the business to deliver reliable, high-performance data infrastructure. You will contribute to a culture of craft and growth, with flexible working options including hybrid and remote