Data Engineer - SC Clearance

JR United Kingdom; Leeds; On-site; GBP 65,000 - 75,000; Full time

Job summary

Join a leading digital intelligence organization at the forefront of data-driven transformation for the public sector. This exciting opportunity for a Data Engineer with active SC Clearance involves developing scalable Azure Data Factory pipelines and implementing data security measures. You will play a key role in transforming a proof-of-concept into a robust, production-ready data platform using cutting-edge Microsoft Azure technologies. Enjoy flexible working arrangements and a range of employee benefits while contributing to impactful projects that drive innovation and efficiency in the public sector.

Benefits

Employee share plans

Flexible benefits

Private healthcare

Lifestyle discounts

Annual performance bonus

Qualifications

• Active SC Security Clearance is essential due to project sensitivity.
• Experience with Azure Data Factory and data security techniques.

Responsibilities

• Develop scalable Azure Data Factory pipelines for data processing.
• Enhance security and manageability of data ingestion processes.

Skills

Azure Data Factory

Data Security

Performance Tuning

Data Ingestion

Managed Identities

SQL

STAR Schema

Job description

Social network you want to login/join with:

Data Engineer - SC Clearance, Leeds, West Yorkshire

Client: Stott and May

Location: Leeds, West Yorkshire, United Kingdom

Job Category: Other

EU work permit required: Yes

Job Views: 4

Posted: 28.04.2025

Expiry Date: 12.06.2025

Job Description:

Leeds (Hybrid and Flexible Working Available)

Salary: 65K + Bonus

Must Have Active SC Clearance

Join a leading digital intelligence organisation working at the forefront of data-driven transformation for the public sector. We are looking for a Data Engineer with active SC Clearance to help evolve a successful proof-of-concept into a fully productionised and supported data platform using cutting-edge Microsoft Azure technologies.

What You’ll Be Doing:

Our client has partnered with Mobilise to explore and validate a modern data warehouse and business intelligence ecosystem. This included a proof-of-concept showcasing Microsoft’s data stack to unlock actionable insights and improve reporting.

We are now transforming this into a robust, scalable, secure production environment. You’ll play a key role in:

• Developing scalable Azure Data Factory pipelines
• Enhancing security, manageability, and cost-efficiency
• Building reusable, templated data ingestion processes
• Applying data segregation, masking, and pseudonymisation techniques

What You’ll Bring:

Must Have:

Active SC Security Clearance – essential due to project sensitivity.

Technical Skills:

• Incremental dimension creation to reduce costs
• Secure authentication using managed identities or service principals
• Performance tuning for ADF pipelines
• Reusable templating for ingestion patterns
• Integration with Microsoft Entra ID (formerly Azure AD)
• STAR schema implementation
• Standardising naming conventions and schemas
• Migrating data processing logic from Power BI to SQL
• Implementing data security, masking, and pseudonymisation techniques

What’s In It For You:

• Employee share plans
• Flexible benefits (green car scheme, private healthcare, lifestyle discounts)
• Annual performance bonus (where eligible)