Azure Data Engineer - Fabric Migration & Data Platform

Cognizant; Sheffield; Hybrid; GBP 65,000 - 90,000; Full time

Benefits offered by this job

Hybrid work model

Career progression opportunities

Job summary

Cognizant in Sheffield is seeking an experienced Azure Data Engineer to design, develop and deliver modern data platform solutions with a focus on Microsoft Fabric migration. You will drive data engineering and migration activities, collaborating with engineering teams to deliver scalable and well-tested data solutions.

The role requires strong Azure data technologies expertise and the ability to guide migration engineers, QA resources and stakeholders towards successful delivery.

Qualifications

• Experience designing and delivering Azure-based data platform solutions.
• Hands-on PySpark, SQL and Python development skills.
• Real-time/streaming use with Kafka or similar services.
• Strong knowledge of Spark processing and performance tuning.
• Experience with Parquet, JSON, XML and CSV data formats.
• Experience with Azure DevOps / GitHub and CI/CD pipelines.
• Power BI experience is desirable.

Responsibilities

• Configure data ingestion processes and solutions.
• Lead the execution of Microsoft Fabric migration activities.
• Lead and guide migration engineers and QA resources.
• Develop Python, PySpark and Spark SQL code for data validation and curation.
• Create data integration test cases and support testing activities.
• Implement and amend data processing and worker pipelines.
• Implement data validation and curation rules.
• Translate data models and mappings into detailed technical data mappings.
• Design and implement data integrations.
• Support data migration activities.
• Perform data analysis and profiling.
• Configure Azure DevOps / GitHub environments and CI/CD for ADF and Databricks.

Skills

Azure data platform

PySpark

SQL

Python

Kafka

Azure DevOps

GitHub

Azure Synapse

Databricks

Spark tuning

3NF modelling

Data Vault 2.0

Power Apps

AKS

Web Apps

Python (general)

Tools

AKS

Azure Functions

Azure Data Factory

Databricks

Power BI

Job description

Cognizant in Sheffield is seeking an experienced Azure Data Engineer to design, develop and deliver modern data platform solutions with a focus on Microsoft Fabric migration. You will drive data engineering and migration activities, collaborating with engineering teams to deliver scalable and well-tested data solutions.

The role requires strong Azure data technologies expertise and the ability to guide migration engineers, QA resources and stakeholders towards successful delivery.