Remote Azure Data Engineer - Medallion Pipelines

ShareForce Ltd; United Kingdom; Remote; GBP 88,000 - 115,000; Full time

Benefits offered by this job

Fully remote work

Job summary

ShareForce Ltd. is seeking an Azure Data Engineer to join a public sector project focused on delivering a scalable, reusable data platform across the enterprise.

You will design, build, and maintain data pipelines on Microsoft Azure, and develop reusable data products to reduce duplication. You will work with cross-functional teams to promote standards, patterns, and best practices, contribute to documentation, and optimize workflows using notebooks and distributed processing frameworks.

Qualifications

• Experience with Python for data engineering.
• Hands-on PySpark and distributed data processing.
• Advanced SQL skills for data transformation and optimisation.
• Experience in notebook environments (Fabric, Databricks, or similar).
• Practical experience with Microsoft Fabric or Azure data services.
• Solid understanding of medallion architecture and layered data design.
• Experience building and maintaining ETL/ELT pipelines.
• Familiarity with version control (Git) and collaborative development workflows.

Responsibilities

• Design, build, and maintain scalable data pipelines on Microsoft Azure.
• Develop reusable data products and frameworks to reduce duplication across teams.
• Implement and maintain medallion architecture (Bronze, Silver, Gold) for structured data processing.
• Work with cross-functional teams to promote shared standards and engineering best practices.
• Contribute to open and transparent development practices, including code sharing and documentation.
• Develop and optimise data workflows using notebooks and distributed processing frameworks.
• Ensure data quality, reliability, and performance across the platform.
• Support the evolution of a modern enterprise data platform, reducing siloed solutions.

Skills

Python

PySpark

SQL

Notebook environments

Microsoft Fabric / Azure data services

Medallion architecture

ETL/ELT pipelines

Git

Tools

Databricks

Fabric

Job description

ShareForce Ltd. is seeking an Azure Data Engineer to join a public sector project focused on delivering a scalable, reusable data platform across the enterprise.

You will design, build, and maintain data pipelines on Microsoft Azure, and develop reusable data products to reduce duplication. You will work with cross-functional teams to promote standards, patterns, and best practices, contribute to documentation, and optimize workflows using notebooks and distributed processing frameworks.