Azure Data Engineer - Must Have Active Sc Clearance

Skillsbay Limited; City of Westminster; On-site; GBP 100,000 - 125,000; Full time

Job summary

A UK-based IT services firm is looking for an Azure Data Engineer with 10+ years of data engineering experience. The candidate must have at least 3 years of hands-on experience with Azure Databricks, strong proficiency in Python or Scala, and a deep understanding of data warehousing principles. The role offers a contract of 6 months with a pay rate of £450-£500 Inside IR35. An active SC clearance is required for this position immediately based in London.

Qualifications

• Proven expertise with Databricks, including hands-on implementation experience and certifications.
• Experience with data quality and data governance processes.
• Experience with data architecture design and pipeline optimization.

Responsibilities

• Develop and maintain data pipelines using Azure services.
• Collaborate with data architects to design scalable solutions.
• Implement data governance practices to ensure data quality.

Skills

10+ years of experience in data engineering

Hands-on experience with Azure Databricks

Proficiency in Python and Spark (PySpark) or Scala

Understanding of data warehousing principles

Experience with Azure data services

Working with large datasets and complex data pipelines

Experience with SQL and NoSQL databases

Experience with Git

Familiarity with Agile development methodologies

Job description

AZURE DATA ENGINEER - MUST HAVE ACTIVE SC CLEARANCE

London - 450 - 500 Inside Contract

Posted by: Skillsbay

Posted: Friday, 19 December 2025

Essential Skills & Experience

• 10+ years of experience in data engineering, with at least 3+ years of hands‑on experience with Azure Databricks
• Good proficiency in Python and Spark (PySpark) or Scala
• Deep understanding of data warehousing principles, data modelling techniques, and data integration patterns
• Extensive experience with Azure data services, including Azure Data Factory, Azure Blob Storage, and Azure SQL Database
• Experience working with large datasets and complex data pipelines
• Experience with data architecture design and data pipeline optimization
• Proven expertise with Databricks, including hands‑on implementation experience and certifications
• Experience with SQL and NoSQL databases
• Experience with data quality and data governance processes
• Experience with version control systems eg, Git
• Experience with Agile development methodologies

Details

• Location: London, UK
• Industry: IT
• Duration: 6 months
• Start Date: ASAP
• Rate: 450 - 500 Inside
• Employment Business: Skillsbay
• Contact: Isobelle Preston
• Telephone: [phone]
• Email: Contact This Employment Business
• Reference: JSAZURE DATA
• Posted Date: 12/19/2025 2:00:30 AM
• Permalink: http://www.careerboard.com/e9xtR