Senior Spark and Microsoft Fabric Engineer (Contract)

JR United Kingdom; United Kingdom; Remote; GBP 50,000 - 90,000; Full time

Job summary

An innovative firm is seeking a Senior Spark and Microsoft Fabric Engineer to join their dynamic team. This remote position offers the opportunity to work on cutting-edge data engineering projects, focusing on designing robust data pipelines and optimizing Spark jobs for performance. The ideal candidate will have extensive experience with Spark, Delta Tables, and data pipeline development, alongside proficiency in Python and C#. Join this forward-thinking company and contribute to exciting projects that drive innovation in the data engineering space.

Qualifications

• Extensive experience in Spark and data pipeline development.
• Proficiency in Python, C#, and YAML for scripting.

Responsibilities

• Investigate and resolve issues in Spark jobs, optimizing performance.
• Design and implement data pipelines in Microsoft Fabric.

Skills

Spark

Microsoft Fabric

Python

C#

YAML

Delta Tables

Data Pipeline Development

Performance Tuning

Tools

Azure

Terraform

Job description

Social network you want to login/join with:

Senior Spark and Microsoft Fabric Engineer (Contract), united kingdom

col-narrow-left

Client:

Experis UK

Location:

Job Category:

Other

-

EU work permit required:

Yes

col-narrow-right

Job Views:

3

Posted:

08.05.2025

Expiry Date:

22.06.2025

col-wide

Job Description:

Senior Spark and Microsoft Fabric Engineer (Contract)

Are you a seasoned expert in Spark, Microsoft Fabric, and data engineering technologies? We are seeking talented individuals to join our dynamic team at the forefront of innovation.

Position: Senior Spark and Microsoft Fabric Engineer

Location: Remote - UK Based

Responsibilities:

• Investigate and resolve complex issues in Spark jobs, including edge case debugging and performance optimizations.
• Design and implement robust data pipelines in Microsoft Fabric, integrating data from diverse sources and enhancing existing libraries.
• Manage schema evolution in Delta Tables, ensuring seamless updates and data integrity.
• Monitor and optimize resource allocation for Spark jobs to maximize efficiency and scalability.
• Collaborate on deployments, ensuring Azure resources are deployed effectively using Terraform scripts.

Requirements:

• Extensive experience with Spark, Delta Tables, and data pipeline development.
• Proficiency in Python, C#, and YAML for scripting and configuration.
• Strong problem-solving skills with a focus on performance tuning and scalability.
• Client-facing experience with excellent communication and collaboration skills.

Contract:

• Contract - PAYE
• Remote - UK Based
• Length - Up to 18 Months

Please apply for immediate consideration!