Associate Data Engineer

NHS South Yorkshire Integrated Care Board; Sheffield; Hybrid; GBP 42,000 - 65,000; Full time

Job summary

NHS South Yorkshire Integrated Care Board is seeking an Associate Data Engineer for a full-time, hybrid role within the Data & Analytics team. The post focuses on maintaining and expanding our Azure SQL/Data Warehouse environments and building robust data pipelines.

Ideal candidates will have strong SQL skills, NHS data experience, and familiarity with cloud-based data platforms. Collaboration with external organisations and adherence to NHS information governance are essential.

Qualifications

• Experience with SQL databases and large data warehouses.
• Experience with cloud-based data platforms and NHS data environments.
• Ability to explain technical concepts to non-technical audiences.
• Knowledge of data security and information governance.
• Experience collaborating with stakeholders and external organisations.

Responsibilities

• Maintain and monitor Azure SQL databases and managed instances.
• Build, monitor, and maintain Azure Data Factory pipelines.
• Utilise Microsoft Fabric along with Azure services (Storage, Events, Alerts, Power BI, Analysis Services).
• Implement NHS policy-based security and compliance measures.
• Document data sources and logic used to build Data Centre structures.
• Communicate complex analytics to colleagues and advise accordingly.
• Maintain data centre availability for end users and analysts.

Skills

SQL skills

Data analysis

Communication

Education

Degree level qualification in IT or numerate subject

Tools

Azure SQL

Azure SQL Managed Instance

Azure Data Factory

Microsoft Fabric

Power BI

Analysis Services

Job description

NHS South Yorkshire Integrated Care Board

Associate DataEngineer

The closing date is 24 November 2026

Avacancy has arisen for a full time, hybrid working, permanent Associate DataEngineer to support the development and ongoing function of our Data Centrewithin the Data and Analytics team at NHS South Yorkshire.

Theposition is to assist in the maintenance and expansion of the Integrated CareBoards database repositories. This role requires excellent SQL skills andexperience of database management of a large data warehouse, preferably cloudbased.

Pleasenote as an organisation we are unable to offer sponsorship.

Main duties of the job

• Provide day-to-day maintenance of our Azure SQL and Azure SQL Managed Instance Databases.
• Build, monitor and maintain Azure Data Factory (ADF) Pipelines.
• Understand & utilise Microsoft Fabric along with other Microsoft and Azure services such as Storage, Events, Alerts, Power BI, & Analysis Services from an engineering perspective.
• Understand, for engineering purposes, and implement appropriate security and compliance measures based on NHS policies and industry best-practice.
• Document sources and logic used to build Data Centre structures.
• Communicate complex analytical matters to others and advise accordingly.
• Maintain and monitor the Data Centre to ensure high availability for end users and analysts and continue development.
• Working with the external organisations and key ICB contacts.

The ideal candidate will

• Have experience of NHS systems.
• Have experience of working with cloud-based data platform solutions.
• Have experience of working in a multi-disciplinary team.

About us

NHS South Yorkshire Integrated Care Board oversees healthand social care for a population of 1.4m people. Working through our 4 places, Barnsley, Doncaster, Rotherham, and Sheffield, we are building on thestrengths, capacity and knowledge of all those directly involved with our localcommunities to deliver our four key aims of Improving outcomes inpopulation health and healthcare; Tackling inequalities in outcomes, experienceand access; Enhancing productivity and value for money; and Helping the NHSsupport broader social and economic development.

Our near 1,000 staff are committed to addressing the broaderhealth, public health, and social care needs of the population across SouthYorkshire through our values of One Team, Empowered and Innovative. We work as a key partner with theIntegrated Care Partnership (ICP) of health and care providers within the SouthYorkshire Integrated Care System (ICS) to collectively deliver health and careservices that meet the needs of the local population. In total there are 186 GPpractices in the region, 72,000 health and social care professionals workingacross seven NHS trusts and four local authorities, and a further 6,000voluntary, community and social enterprise sector (VCSE) organisations. We workalongside all these colleagues through local councils, our VCSEpartners and other partners to address health inequalities and widerdeterminants of health in South Yorkshire.

South Yorkshire ICB is a Disability Confident Employer

Job responsibilities

The post holder supports the management of data across its full lifecycle, from data extraction, through transformation and loading into a curated asset and data products for onward use in the production of analytical insights. Working as part of multi-disciplinary teams alongside colleagues from across Data & Insights, the role holder will ensure that data are handled in an efficient and secure way in line with information governance legislation.

The role holder will apply skills across a range of data management and analysis areas including

• Supporting Requirements gathering and build of specifications across a wide array of stakeholders, both internal and external
• implement data flows to connect operational systems, data for analytics and business intelligence (BI) systems
• re-engineer manual data flows to enable scaling and repeatable use
• support the build of data streaming systems and automated reports
• write ETL (extract, transform, load) scripts and code to ensure the ETL process performs optimally
• develop business intelligence reports that can be reused
• build accessible data for analysis
• Cloud and on-premise database and data pipeline management

The post holder can work under direction to identify and use the most appropriate techniques, and you have an understanding of data engineering tools. You can demonstrate numeracy. You can show an awareness of advances in digital analytics tools and data manipulation products and can keep up to date with them. You can collect, collate, cleanse, synthesise and interpret data to derive meaningful and actionable insights.

This post will comply with all regulatory requirements in such areas as data quality and data security, within an environment that is committed to the proper

Qualifications

• Degree level qualification in an IT or numerate related subject or equivalent qualification/experience.
• Experience of presenting and explaining through written and verbal communication in a style that translates technical detail into user friendly, accessible plain English that can be understood by all audiences.
• Experience of having discussions with stakeholders (internal and external) to clarify or define specifications.
• Experience of database configuration, performance tuning and administration.
• Experience in NHS information flows, hospital systems and applications.
• Significant experience of ETL and data warehouse schemas, and relational database systems.
• Experience of working with cloud-based data platform solutions.

Attributes

• Able to work flexibly within situations of ambiguity.
• Is self motivated, self aware and proactive.
• Commitment to and focus on quality and meeting standards.
• Fosters good working relationships and embraces diversity & inclusion.
• Committed to professional development.

Skills and Competencies

• Excellent written, documentation and oral communication skills and abilities.
• Can easily interpret the quality of data through proactive identification of poor data quality and propose appropriate solutions.
• Experience of curating data and building data assets to meet a business need.
• Experience of creating automated extract, transform and load processes to optimize insight delivery.
• Ability to use initiative to decide relevant actions, make recommendations and make decisions autonomously, when required, on difficult issues, working to tight and often changing timescales.

Knowledge and Understanding

• Good working knowledge and experience in the effective use of spreadsheets and databases including use of data interrogation tools and wider functionality such as formulae.
• Knowledge of how to interpret data.
• Significant experience and knowledge of database structures and how to interrogate and maintain databases.
• Knowledge of process design and code development acquired through degree level or equivalent qualification/experience.
• Able to exhibit knowledge of relevant legislation when working with public data such as the Data Protection Act and GDPRR.
• Advanced knowledge of industry-standard data management tools, such as MS SQL, Python, Oracle.
• Working knowledge of agile methodologies or relevant experience or training.
• Awareness of configuration of cloud-based data platforms and build of data pipelines across multiple data assets.
• Knowledge of testing and assurance processes; including, development of test plans; an understanding of reference data management and its application.
• Knowledge of health and care information flows, hospital systems and applications.

Disclosure and Barring Service Check

This post is subject to the Rehabilitation of Offenders Act (Exceptions Order) 1975 and as such it will be necessary for a submission for Disclosure to be made to the Disclosure and Barring Service (formerly known as CRB) to check for any previous criminal convictions.

NHS South Yorkshire Integrated Care Board