Data Engineer - SC Clearance

Stott and May; Leeds; Hybrid; GBP 65,000; Full time

Job summary

An established industry player is on the lookout for a Data Engineer with active SC Clearance to join their innovative team. This role involves transforming a proof-of-concept into a robust data platform using cutting-edge Microsoft Azure technologies. You will be at the forefront of developing scalable Azure Data Factory pipelines and implementing STAR schema-based data models. The organization offers a dynamic work environment with flexible working options and a competitive benefits package, making it an exciting opportunity for professionals eager to make a significant impact in the public sector's data-driven transformation.

Benefits

Competitive pension scheme

Employee share plans

Flexible benefits

Private healthcare

Lifestyle discounts

Annual performance-related bonus

Qualifications

• Active SC Clearance is mandatory for this role.
• Experience with Azure Data Factory and Azure SQL is essential.

Responsibilities

• Develop scalable Azure Data Factory pipelines for data operations.
• Implement STAR schema-based data models in Azure SQL.

Skills

Azure Data Factory

Azure SQL

Security Clearance (SC)

Data Masking

Data Pseudonymisation

Performance Tuning

Tools

Microsoft Azure

Job description

Data Engineer - SC Clearance
Leeds (Hybrid and Flexible Working Available)
£65K + Bonus
**MUST HAVE ACTIVE SC CLEARANCE

Join a leading digital intelligence organisation working at the forefront of data-driven transformation for the public sector. We are looking for a Data Engineer with active SC Clearance to help evolve a successful proof-of-concept into a fully productionised and supported data platform using cutting-edge Microsoft Azure technologies.

What You’ll Be Doing:
Over the past four years, our client has partnered with Mobilise to explore and validate a modern data warehouse and business intelligence ecosystem. This journey included a full proof-of-concept, showcasing the potential of Microsoft’s data stack to unlock actionable insights and improve internal reporting capabilities.

We are now entering the next phase: transforming this proof-of-concept into a robust, scalable, and secure production environment. You’ll play a key role in delivering this vision as part of an agile team focused on:

1. Developing scalable Azure Data Factory pipelines
2. Implementing STAR schema-based data models in Azure SQL
3. Enhancing security, manageability, and cost-efficiency of data operations
4. Building reusable, templated data ingestion processes
5. Applying data segregation, masking, and pseudonymisation techniques

What You’ll Bring:
MUST HAVE:

1. Active Security Clearance (SC) – This is a non-negotiable requirement due to the sensitive nature of the project.

Technical Skills:
Azure Data Factory (ADF):

1. Incremental dimension creation to reduce compute and data processing costs
2. Integration using managed identities or service principals for secure authentication
3. Parallelism and performance tuning for ADF pipelines
4. Templating for reusable, scalable ingestion patterns

Azure SQL:

1. Integration with Microsoft Entra ID (formerly Azure AD)
2. STAR schema implementation for analytic models
3. Standardising naming conventions and schema organisation
4. Migrating data processing logic from Power BI to the SQL layer
5. Applying robust data security, masking, and pseudonymisation techniques

What’s In It For You:

1. Competitive pension scheme
2. Employee share plans
3. Flexible benefits (including green car scheme, private healthcare, and lifestyle discounts)
4. Annual performance-related bonus (where eligible)