Lead Data Engineer, Azure Data Factory & Pipelines

Cognizant; England; On-site; GBP 60,000 - 90,000; Full time

Job summary

Cognizant is seeking a skilled Data Engineer in the United Kingdom to design, build, and maintain scalable ETL/ELT pipelines using Azure Data Factory. You will optimize SQL queries, mentor junior engineers, and ensure end-to-end delivery from requirements through deployment and support.

The role requires strong SQL, Azure Data Factory experience, and a solid understanding of the Azure data ecosystem. Collaboration with analysts and stakeholders is essential to translate business needs into

Qualifications

• 4+ years of experience with Azure Data Factory (ADF) and end-to-end pipeline development.
• Strong SQL skills including complex joins, window functions, and query tuning.
• Experience with the Azure data ecosystem: ADLS Gen2 and Azure SQL Database.
• Experience with version control (Git) and CI/CD pipelines (Azure DevOps preferred).
• Understanding of data governance, security, and compliance practices.
• Strong analytical, debugging, and problem-solving skills.

Responsibilities

• Design, develop, and maintain robust ETL/ELT pipelines using Azure Data Factory.
• Optimize SQL queries and data transformations for performance.
• Own end-to-end delivery from requirements to deployment and support.
• Mentor junior data engineers and review code/pipeline designs.
• Implement data quality checks, validation frameworks, and error-handling within pipelines.
• Integrate data from APIs and flat files; collaborate with analysts and stakeholders to translate requirements.
• Contribute to CI/CD implementation for data pipeline deployments.
• Maintain technical documentation for pipelines and architecture.

Skills

SQL proficiency

ADF (Azure Data Factory)

Data engineering

Azure ADLS Gen2

Performance tuning

Git & CI/CD

Data governance & security

Troubleshooting

Tools

Azure DevOps

Git

Databricks

Azure Data Factory

Job description

Cognizant is seeking a skilled Data Engineer in the United Kingdom to design, build, and maintain scalable ETL/ELT pipelines using Azure Data Factory. You will optimize SQL queries, mentor junior engineers, and ensure end-to-end delivery from requirements through deployment and support.

The role requires strong SQL, Azure Data Factory experience, and a solid understanding of the Azure data ecosystem. Collaboration with analysts and stakeholders is essential to translate business needs into