SW Secure Data Environment Senior Data Engineer

NHS Bristol, North Somerset and South Gloucestershire Integrated Care Board; West of England; Hybrid; GBP 58,000 - 65,000; Full time

Benefits offered by this job

Hybrid working

Flexible regional/home working

Job summary

NHS Bristol, North Somerset and South Gloucestershire Integrated Care Board is seeking a Senior Data Engineer to lead the Southwest Secure Data Environment (SWSDE). The role focuses on secure data pipelines, models and research-ready datasets for health and care data use in research and transformation.

Applicants should have strong SQL and Python skills, data integration and modelling expertise, and experience with complex, regulated data environments.

Qualifications

• Educated to master's level or equivalent senior-level experience in a specialist data/analytics environment.
• Significant experience designing, developing and supporting complex data pipelines and data integration solutions.
• Strong hands-on experience using SQL, Python and relevant modern data engineering tools/technologies.
• Experience with large-scale health data or public sector datasets and data modelling.

Responsibilities

• Lead design, development, testing and delivery of complex health and care data pipelines, models and datasets.
• Translate research and provider needs into technical specifications for secure, scalable solutions.
• Profile, validate and ensure data quality across source systems and datasets.
• Automate data delivery processes to improve reliability and efficiency.
• Coordinate engineering across projects, identifying risks and dependencies.
• Provide technical leadership, peer review, and mentoring to engineers.

Skills

SQL

Python

Data integration

Data modelling

Engineering practices

Education

Master's degree or equivalent

Job description

Employer NHS Bristol, North Somerset and South Gloucestershire Integrated Care Board Employer type NHS Site Bristol, Gloucester and hybrid working Town Bristol Gloucester Salary £57,528 - £64,750 per annum Salary period Yearly Closing 25/10/2026 23:59

SW Secure Data Environment Senior Data Engineer

NHS AfC: Band 8a

Job overview

We are seeking an experienced Senior Data Engineer to provide technical leadership and hands-on expertise within the Southwest Secure Data Environment (SWSDE). SWSDE enables secure use of health and care data for research, innovation, service improvement and transformation. Working with NHS organisations, universities and research partners, it supports better outcomes and data-driven decisions.

The postholder will lead the design, development, testing and implementation of complex data pipelines, models and research-ready datasets. Working with NHS providers, researchers, technical teams and delivery partners, you will turn complex requirements into secure, scalable and reusable engineering solutions.

You will combine strong technical skills with the ability to lead complex engineering activity, solve difficult data problems and develop other engineers. Essential experience includes SQL, Python, data integration, data modelling and modern engineering practices.

NHS or healthcare data experience is valuable, but we also welcome applicants from research, public-sector or other complex, regulated environments who offer strong engineering skills and fresh thinking.

The role is administratively based in Bristol, with applications welcome from across the Southwest. Flexible regional and home working is available, with travel to partner organisations as required.

Main duties of the job

The postholder will:

· Lead the design, development, testing and delivery of complex health and care data pipelines, models and research-ready datasets.

· Translate research, operational and provider needs into technical specifications and secure, scalable, reusable solutions using SQL, Python and modern engineering technologies.

· Work with NHS providers to understand source systems, datasets, coding, data flows and constraints.

· Profile and validate data, resolving quality issues and leading extraction, ingestion, transformation, linkage and curation.

· Automate processes to improve the reliability, repeatability, traceability and efficiency of data delivery.

· Coordinate engineering across projects, datasets and providers; identify risks, dependencies, capacity issues and barriers, acting or escalating as needed.

· Guide and mentor engineers, peer-review code, pipelines, models, transformations and documentation.

· Promote version control, testing, documentation, reusable components and agreed development practices.

· Work with platform, cloud, architecture, cyber security and information governance teams to meet requirements.

· Maintain documentation, metadata, data dictionaries, lineage and quality controls, and improve SWSDE standards, patterns and cloud capability.

Working for our organisation

We are committed to creating an inclusive organisation that promotes and values diversity. We know from experience that different ideas, perspectives and backgrounds create a stronger, more creative workplace that helps us to deliver the best services. We welcome applications which represent the rich diversity of our community; from people of all ages, disabled people, all genders, people from ethnic minority groups, LGBTQ+ people, people with diverse gender identity and expression, people from all religions and beliefs and other diverse characteristics, and we have processes in place to ensure that all applications are treated fairly and consistently at every stage of the recruitment process.

Detailed job description and main responsibilities

Educated to master's level or equivalent senior-level experience within a specialist data, analytics, digital or technical environment.

Significant experience designing, developing and supporting complex data pipelines, transformations and data integration solutions.

Strong hands-on experience using SQL, Python and relevant modern data engineering tools and technologies.

Experience working with large-scale health, research, public sector or similarly complex datasets.

Strong knowledge of data modelling, data quality assurance, metadata management and data validation techniques.

Ability to analyse complex datasets, data structures and technical requirements and determine appropriate engineering approaches.

Experience planning and delivering complex data engineering or integration activity within agreed timescales and resources.

Ability to manage multiple projects, technical priorities and deliverables simultaneously.

Experience providing technical leadership, peer review, mentoring and guidance to engineers or technical colleagues.

Excellent communication skills, with the ability to translate complex requirements and explain technical concepts to technical and non-technical audiences.

Strong problem-solving skills and the ability to resolve complex data quality, integration and interoperability issues.

Understanding of information governance, cyber security, data protection and relevant compliance requirements.

Ability to work collaboratively with data providers, researchers, suppliers and partner organisations across organisational boundaries.

Commitment to technical quality, inclusive working, knowledge sharing, innovation and continuous improvement.

Experience working with NHS data, health research infrastructure, Secure Data Environments or Trusted Research Environments.

Knowledge of NHS datasets, coding systems, data standards and healthcare information flows.

Experience of cloud-based data engineering using Azure, AWS or an equivalent platform.

Experience of DevOps, automation, infrastructure-as-code or platform engineering approaches.

Knowledge of interoperability standards or common data models such as OMOP, FHIR or openEHR.

Knowledge of SATRE, the Data Security and Protection Toolkit, ISO 27001 or other relevant security and assurance frameworks.

Person specification

Knowledge, Training and Experience

• Educated to masters level or equivalent experience working at a senior level within a specialist data, analytics, digital or technical environment.
• Extensive specialist knowledge gained through postgraduate study, professional qualification or significant experience in data engineering, data integration, health informatics, analytics, data architecture or digital services.
• Significant experience designing, developing and supporting complex data pipelines, data transformations and data integration solutions.
• Significant experience working with large-scale health and care datasets within NHS, research or public sector environments.
• Experience of designing, developing and maintaining data engineering solutions using SQL, Python and relevant modern data engineering tools and technologies.
• Experience of data modelling, data quality assurance, metadata management and data validation techniques.
• Experience working with complex NHS datasets, data standards, coding systems and healthcare information flows.
• Understanding of information governance, cyber security, data protection and NHS or public sector compliance frameworks.
• Understanding of the NHS, wider health and care system landscape and national digital and data priorities.
• Demonstrates strong digital literacy and effective use of modern digital, data and collaboration tools.
• Experience working within NHS, health research, analytics or Secure Data Environment (SDE/TRE) programmes.
• Knowledge of SATRE, DSPT, ISO27001 or other relevant standards and assurance frameworks.
• Experience of cloud-based data engineering using Azure, AWS or equivalent platforms.
• Experience of infrastructure-as code, automation, DevOps or platform engineering approaches.
• Experience of interoperability standards and common data models such as OMOP, FHIR or openEHR.

Communication Skills

• Excellent communication skills with the ability to explain complex technical and data engineering concepts to technical and non-technical audiences.
• Ability to communicate effectively with NHS providers, researchers, suppliers and partner organisations.
• Strong presentation, facilitation and stakeholder engagement skills.
• Ability to build collaborative relationships across organisational and professional boundaries.
• Ability to translate operational, research or business requirements into practical technical approaches and engineering solutions.
• Experience presenting technical findings, data quality assessments or engineering solutions to governance groups and technical forums.

Analytical

• Ability to analyse highly complex datasets, data structures, mappings and technical requirements and determine appropriate engineering approaches.
• Ability to investigate and resolve complex data quality, integration and interoperability issues where there may be multiple potential solutions.
• Ability to balance technical, operational, information governance and delivery considerations when making recommendations.
• Experience identifying, assessing and resolving technical risks associated with data engineering, onboarding and data processing activities.
• Strong problem-solving skills and ability to work effectively in complex, ambiguous and rapidly changing environments.
• Experience analysing platform performance, pipeline performance, data quality metrics or cloud based engineering workloads.
• Experience applying analytical techniques to support data validation, optimisation and continuous improvement.

Planning Skills

• Experience planning and delivering complex data engineering, integration and onboarding activity within agreed timescales and available resources.
• Ability to manage multiple competing priorities, projects and technical deliverables simultaneously.
• Experience developing implementation plans, technical specifications and engineering work packages.
• Experience coordinating technical activity across multiple contributors, organisations or datasets.
• Experience of agile delivery, DevOps or modern technical delivery methodologies.

Management Skills

• Experience providing technical leadership, mentoring and guidance to engineers, analysts or technical colleagues.
• Experience coordinating technical activity across multiple projects, datasets and engineering priorities.
• Experience undertaking technical peer review, quality assurance and promotion of engineering standards and best practice.
• Experience supporting knowledge transfer, technical development and capability building within engineering teams.
• Experience working collaboratively with suppliers, provider organisations and delivery partners to support engineering delivery.
• Experience of line management, supervision or coaching responsibilities.
• Experience contributing to recruitment and technical assessment processes.
• Experience developing engineering capability within multidisciplinary teams.

Employer certification / accreditation badges

Name Kane O'Beirne Job title Head of Operations SW Secure Data Environment Email address [e-mail]