SC-Cleared Databricks Engineer — Azure Data Pipelines Lead

Shareforce; United Kingdom; Hybrid; GBP 80,000 - 100,000; Full time

Job summary

A technology consulting firm is seeking a SC Cleared Databricks Engineer to join their team in the UK. The role involves designing and delivering advanced Databricks solutions in the Azure ecosystem, focusing on data analytics and AI. The ideal candidate will have proven experience with Databricks and Azure, strong coding skills, and the ability to mentor junior engineers. This position offers a competitive rate and a hybrid working model.

Qualifications

• Proven experience in designing data solutions in Azure using Databricks.
• Hands-on expertise in Delta Lake and Delta Live Tables.
• Strong coding skills in Python and SQL.

Responsibilities

• Design, build, and optimise end-to-end data pipelines using Azure Databricks.
• Collaborate with stakeholders to define technical requirements.
• Drive best practices for data engineering.

Skills

Designing data solutions in Azure using Databricks

Delta Lake and Delta Live Tables

Python coding skills

SQL expertise

Lakehouse architecture understanding

Azure Data Factory knowledge

CI/CD practices with Azure DevOps

Excellent communication skills

Education

Certification in Databricks Data Engineer or Azure Data Engineer

Job description

A technology consulting firm is seeking a SC Cleared Databricks Engineer to join their team in the UK. The role involves designing and delivering advanced Databricks solutions in the Azure ecosystem, focusing on data analytics and AI. The ideal candidate will have proven experience with Databricks and Azure, strong coding skills, and the ability to mentor junior engineers. This position offers a competitive rate and a hybrid working model.