Azure Data Engineer - SC Cleared, Databricks Expert

Skillsbay Limited; City of Westminster; On-site; GBP 100,000 - 125,000; Full time

Job summary

A UK-based IT services firm is looking for an Azure Data Engineer with 10+ years of data engineering experience. The candidate must have at least 3 years of hands-on experience with Azure Databricks, strong proficiency in Python or Scala, and a deep understanding of data warehousing principles. The role offers a contract of 6 months with a pay rate of £450-£500 Inside IR35. An active SC clearance is required for this position immediately based in London.

Qualifications

• Proven expertise with Databricks, including hands-on implementation experience and certifications.
• Experience with data quality and data governance processes.
• Experience with data architecture design and pipeline optimization.

Responsibilities

• Develop and maintain data pipelines using Azure services.
• Collaborate with data architects to design scalable solutions.
• Implement data governance practices to ensure data quality.

Skills

10+ years of experience in data engineering

Hands-on experience with Azure Databricks

Proficiency in Python and Spark (PySpark) or Scala

Understanding of data warehousing principles

Experience with Azure data services

Working with large datasets and complex data pipelines

Experience with SQL and NoSQL databases

Experience with Git

Familiarity with Agile development methodologies

Job description

A UK-based IT services firm is looking for an Azure Data Engineer with 10+ years of data engineering experience. The candidate must have at least 3 years of hands-on experience with Azure Databricks, strong proficiency in Python or Scala, and a deep understanding of data warehousing principles. The role offers a contract of 6 months with a pay rate of £450-£500 Inside IR35. An active SC clearance is required for this position immediately based in London.