SC-Cleared Data Engineer — Azure Databricks Specialist

Shareforce

North East

Hybrid

GBP 92,000 - 101,000

Part time

12 days ago

Application generator

Stand out for this role — generate a tailored resume and cover letter in about a minute.

Get past ATS filters

Job summary

Shareforce is seeking an SC Cleared Data Engineer to join an experienced team delivering a critical public sector engagement at the forefront of data analytics and AI. The role focuses on designing and delivering advanced Databricks solutions within the Azure ecosystem.

You will design, build, and optimize end-to-end data pipelines in Azure Databricks, mentor juniors, and take ownership of core components while engaging with stakeholders on requirements and estimates.

Qualifications

Proven experience designing and implementing data solutions in Azure using Databricks as a core platform.
Hands-on expertise in Delta Lake, Delta Live Tables and Databricks Workflows.
Strong coding skills in Python and SQL, with experience in developing modular, reusable code in Databricks.

Responsibilities

Design, build, and optimise end-to-end data pipelines using Azure Databricks, including Delta Live Tables.
Collaborate with stakeholders to define technical requirements and propose Databricks-based solutions.
Drive best practices for data engineering.
Help clients realise the potential of data science, machine learning, and scaled data processing within Azure / Databricks ecosystem.
Mentor junior engineers and support their personal development.
Take ownership for the delivery of core solution components.
Support with planning, requirements refinements, and work estimation.