Senior Data Engineer: Azure Databricks & Scalable Pipelines

Cognitive Group | Part of the Focus Cloud Group; Greater London, Newcastle upon Tyne; À distance; GBP 70 000 - 110 000; Plein temps

Avantages offerts par ce poste

30 days annual leave

Pension contribution

Income protection

Employee assistance and wellbeing

Training and development opportunities

Access to online learning

Cycle to Work scheme

Electric Vehicle lease scheme

Résumé du poste

The Cognitive Group | Part of the Focus Cloud Group, London or Newcastle Upon Tyne (UK) is seeking a Senior Data Engineer to build and evolve a modern data platform. You will own data pipelines end-to-end, integrating data from multiple sources and transforming datasets into high-quality information for the business.

This hands-on role requires designing scalable data structures, deploying production data solutions, and collaborating with stakeholders in an Agile environment across the UK.

Qualifications

• Senior-level Data Engineer with hands-on experience across modern data platforms.
• Azure Databricks experience is essential.
• Advanced SQL skills.
• Proven experience building and maintaining production data pipelines.
• Strong experience with Azure Data Factory.
• Experience with Azure Data Lake / ADLS Gen2.
• Strong understanding of data warehousing and data modelling.
• Experience preparing data for Power BI and analytical reporting.
• Experience working in an Agile engineering environment.

Responsabilités

• Design, build, maintain and support scalable data pipelines.
• Integrate data from disparate business and system sources.
• Develop automated solutions to improve efficiency and reduce manual processes.
• Work with large and complex datasets to improve data quality and reliability.
• Design and develop data structures to support reporting and analytics.
• Translate business requirements into robust technical data solutions.
• Build prototypes and iterate quickly to solve emerging data challenges.
• Prepare and structure data for advanced analytics and predictive modelling.
• Work closely with stakeholders and technical teams to understand data requirements.
• Take ownership of data engineering solutions from development through to production.

Connaissances

Azure Databricks

SQL

Data pipelines

Azure Data Factory

Azure Data Lake / ADLS Gen2

Data warehousing

Data modelling

Power BI

Agile

Outils

Azure Data Factory

Azure Databricks

Description du poste

The Cognitive Group | Part of the Focus Cloud Group, London or Newcastle Upon Tyne (UK) is seeking a Senior Data Engineer to build and evolve a modern data platform. You will own data pipelines end-to-end, integrating data from multiple sources and transforming datasets into high-quality information for the business.

This hands-on role requires designing scalable data structures, deploying production data solutions, and collaborating with stakeholders in an Agile environment across the UK.