Data Engineer - Azure / DataBricks

Shareforce; London; Hybrid; GBP 150,000 - 200,000; Full time

Job summary

Une opportunité excitante pour un ingénieur de données Azure certifié SC, axé sur Databricks, pour rejoindre une équipe experte. Le rôle implique la conception de solutions avancées dans l'écosystème Azure, offrant un impact significatif sur l'analyse de données et l'IA, avec une structure de rémunération compétitive.

Qualifications

• Expérience prouvée dans la conception et la mise en œuvre de solutions de données sur Azure.
• Expertise pratique en Delta Lake et Delta Live Tables.
• Compétences en développement de code modulaire et réutilisable sur Databricks.

Responsibilities

• Concevoir et optimiser des pipelines de données end-to-end avec Azure Databricks.
• Collaborer avec des parties prenantes pour définir des exigences techniques.
• Mentorer les ingénieurs juniors et soutenir leur développement personnel.

Skills

Python

SQL

Databricks

Delta Lake

Real-time data processing

CI/CD practices

Communication skills

Education

Certificat en Databricks Data Engineer

Certificat en Azure Data Engineer

Tools

Azure Data Factory

Azure Synapse Analytics

Microsoft Fabric

Azure DevOps

Job description

This is an exciting contract opportunity for an SC Cleared Azure Data Engineer with a strong focus on Databricks to join an experienced team in a new customer engagement working at the forefront of data analytics and AI. This role offers the chance to take a key role in the design and delivery of advanced Databricks solutions within the Azure ecosystem.

Responsibilities:

• Design, build, and optimise end-to-end data pipelines using Azure Databricks, including Delta Live Tables.
• Collaborate with stakeholders to define technical requirements and propose Databricks-based solutions.
• Drive best practices for data engineering.
• Help clients realise the potential of data science, machine learning, and scaled data processing within Azure / Databricks ecosystem.
• Mentor junior engineers and support their personal development.
• Take ownership for the delivery of core solution components.
• Support with planning, requirements refinements, and work estimation.

Skills & Experiences:

• Proven experience designing and implementing data solutions in Azure using Databricks as a core platform.
• Hands-on expertise in Delta Lake, Delta Live Tables and Databricks Workflows.
• Strong coding skills in Python and SQL, with experience in developing modular, reusable code in Databricks.
• Deep understanding of lakehouse architecture, with a solid grasp of data warehousing, data lakes, and real-time data processing.
• Familiar with Azure Data Factory, Azure Synapse Analytics, and Microsoft Fabric.
• Good experience with CI/CD practices and tools for data platforms using Azure DevOps.
• Good knowledge on how to leverage AI to increase deployment productivity and quality.
• Excellent communication skills.
• Desirable: certification in Databricks Data Engineerand/or Azure Data Engineer are a plus.

Additional Information:

• Rate offered: £500-550 per day
• Location: Hybrid with travel to client site 1 day/ week in London
• Start date: Mid/ end of July
• Duration: 3 months initial sign up with significant opportunity for extension (current roadmap demonstrates 9 months scope of work)
• Required: Active SC Clearance