Azure Data Engineer - SC Cleared

Shareforce; London; Hybrid; GBP 150,000 - 200,000; Full time

Job summary

An exciting contract opportunity awaits for an Azure Data Engineer to join a dynamic team at the forefront of data analytics and AI. This role involves designing and implementing scalable data solutions using Azure and Databricks, mentoring junior members, and leading technical discussions with clients. The ideal candidate will have a strong background in enterprise data platforms and a passion for leveraging data science and machine learning. Join a forward-thinking company that empowers organizations to take control of their data and drive their AI evolution. This position offers the chance to work in a hybrid environment with flexible arrangements.

Qualifications

• Experience in designing end-to-end data solutions using Azure services.
• Strong background in enterprise data platform development and methods.

Responsibilities

• Design and implement scalable data pipelines and ETL processes.
• Lead technical discussions and mentor junior team members.

Skills

Azure Data Engineering

Python

SQL

Data Governance

Communication Skills

CI/CD Practices

Data Architecture Principles

Education

Certification in Azure Data Engineering

Certification in Databricks Engineering

Tools

Azure DevOps

Visual Studio Code

Azure Synapse Analytics

Azure Data Factory

Databricks

Job description

This is an exciting contract opportunity for an SC Cleared Azure Data Engineer to join an experienced team in a new customer engagement working at the forefront of data analytics and Artificial Intelligence. Our client equips ambitious organisations with enduring control of their data and AI evolution. This role is an opportunity to lead the build of bespoke data systems for our clients.

Responsibilities:

• Design and implement scalable data pipelines and ETL processes using Azure and Databricks technologies including Delta Live Tables.
• Lead technical discussions with clients and stakeholders to gather requirements and propose solutions.
• Help clients realise the potential of data science, machine learning, and scaled data processing within Azure / Databricks ecosystem.
• Mentor junior team members and support their personal development.
• Take ownership for the delivery of core solution components.
• Support with planning, requirements refinement and work estimation.

Skills and Experiences:

• Design and develop end-to-end data solutions leveraging Azure services for batch, real-time and streaming workloads (including data ingestion, cleansing, modelling and integration).
• Strong background of enterprise data platform development, concepts and methods such as data warehouses and data lakehouse, with the ability to adapt and tailor based on requirements.
• Experience with Azure Synapse Analytics/or Azure Databricks, Microsoft Fabric, Data Factory.
• Expert in Python, SQL and developer tooling such as Visual Studio Code, Azure DevOps.
• Good experience of CI/CD practices and tools for data platforms using Azure DevOps.
• Good knowledge on how to leverage AI to increase development productivity and quality.
• Good understanding of data governance and data architecture principles.
• Excellent communication skills.
• Desirable certification in Azure Data Engineering and Databricks Engineering.

Additional Information:

• Rate offered: £500-550 per day.
• Location: Hybrid with travel to client site 1 day/week.
• Start date: 1st May.
• Duration: 6 months initial sign up with significant opportunity for extension.
• Required: Active SC Clearance.