Data Engineer

The Christie NHS FT; Manchester; On-site; GBP 47,000 - 55,000; Full time

Job summary

A prominent healthcare organization in Manchester seeks an experienced Data Engineer to develop and maintain data pipelines. The role involves managing data transfer, supporting ETL processes with SQL Server and Python, and contributing to the organization's data modernization program. Ideal candidates will have a strong background in data engineering and a commitment to quality patient care. Competitive salary and benefits are included.

Benefits

Flexible working options

Diverse and inclusive environment

Qualifications

• Substantial experience of design, build and deployment of Business Intelligence functions.
• Experience in handling ETL solutions and issues across systems.
• Ability to manage multiple important tasks to completion.

Responsibilities

• Develop and maintain complex data pipelines to the Trust Data Warehouse.
• Produce detailed technical specifications for ETL processes.
• Analyze requirements from Business Intelligence Analysts.

Skills

SQL Server

Python

Advanced T-SQL

Data transfer using XML

Data transfer using JSON

ETL processes

Tableau

Power BI

SQL Server Analysis Services

C#

Education

University Degree in a related subject

UKCHIP registration or equivalent

Microsoft certifications or equivalent

Tools

SQL Server Integration Services (SSIS)

Visual Studio

Job description

Responsible as part of a team to deliver high quality business and complex clinical reporting structures from disparate systems within a consistent and stable framework that is monitored and assured. We are seeking an experienced Data Engineer with a strong background in SQL Server and a commitment to formal change management procedures (RFC) and version control (Git). We are at the start of a five-year Data Engineering modernisation programme; this includes the adoption of Python for developing data pipelines, automating data integration, and building robust data solutions.

We are proud to be a diverse and inclusive organisation and there is a choice of staff networks that help you meet like‑minded people. The Christie supports flexible working, enquiries welcomed. Previous experience of working for the NHS or in a healthcare environment is not essential for this role.

12-month fixed term (renewable)

Main duties of the job

To deliver and maintain data transfer pipelines between clinical/operational source systems and the Christie Central Data Repository (CCDR). Ensure that all extract, transform and load (ETL) processes are robust, operate efficiently and fully documented.

Learn and assist in the development of new tools, technologies and methods of working as they are identified to ensure that they deliver the intended benefits. Support the migration process from legacy reporting and database systems.

Provide a technical support service to all users of Data Engineering, understanding and communicating detailed technical requirements/processes with non-technical staff, managing priorities and expectation of service users. Manage unpredictable support workload.

About us

The Christie is one of Europe's leading cancer centres, treating over 60,000 patients a year. We are based in Manchester and serve a population of 3.2 million across Greater Manchester & Cheshire, but as a national specialist around 15% patients are referred to us from other parts of the country. We provide radiotherapy through one of the largest radiotherapy departments in the world; chemotherapy on site and through 14 other hospitals; highly specialist surgery for complex and rare cancer; and a wide range of support and diagnostic services. We are also an international leader in research, with world first breakthroughs for over 100 years. We run one of the largest early clinical trial units in Europe with over 300 trials every year. Cancer research in Manchester, most of which is undertaken on the Christie site, has been officially ranked the best in the UK.

Job responsibilities

DUTIES AND RESPONSIBILITIES

Develop and maintain complex data transfer pipelines from source systems to the Trust Data Warehouse and Data Marts.

Analyse and interpret requirements and specifications from the Business Intelligence Analysts to inform data construct design, development and assurance processes.

Support the appropriate data warehousing design and software development methodologies agreed for use within the team.

Produce detailed technical specifications and documentation for the support, maintenance, monitoring and quality assurances of ETL processes.

Investigate, support, correct and prevent issues relating to existing Trust developed data reporting systems and processes, identifying issues and implementing resolutions in a timely manner.

Participate in the sprint planning process to determine durations and any dependencies with planned development work.

Develop test plans, and supporting test data, for the developed services in order to validate their stable and maintainable operation against requirements.

Ensure that skills and knowledge are kept up-to-date through professional development.

Make recommendations on new tools, technologies and techniques that can be adopted by the team.

Participate in regular exercises to test business continuity and disaster recovery plans.

Human Resources

Line manage (if applicable) in line with appropriate policies, procedures, working practices and guidelines, ensuring all resources are deployed to maximise an efficient and effective delivery of support services to patients and users.

As requested, provide reports on progress, status and achievements for own work.

Undertake and support the development of staff/placements in line with personal development reviews and other associated guidance.

Provide guidance for staff from own or other disciplines on own subject area, when required.

On limited occasions, by exception, the post holder may be required to work unsociable hours to support and/or enable the delivery of key programmes or projects.

Financial/Physical Resources

Be responsible for the safe and efficient use of hardware, software and financial resources.

Where required, liaise with external agencies, suppliers and contractors ensuring delivery of service is in line with agreed contracts and value for money.

Ensure the post holder adheres to Trust Standing Financial Instructions (SFIs) and procurement guidelines.

Project Management

Advise and participate in the development and implementation of projects as part of planned development sprint cycles.

Ensure project tasks, where required, are successfully delivered in line with agreed timescales and budgets.

Work with line manager to ensure any project management documentation or reports are delivered in line with agreed standards and timescales.

Policy/Service Development/Governance

Act as an ambassador for Digital Services by developing and maintaining excellent working relationships with users across the organisation to deliver a high quality professional service as part of the a development team.

Pro-actively participate in ensuring that Digital services delivered within the Trust reflect best practice with respect to organisational, NHS and legislative requirements and guidelines including IT Infrastructure Library (ITIL), Data Protection Act 2018, Information Standards, Information Security and compliance with NHS Information Governance.

Ensure all documentation relating to own area is complete and fit for purpose and all releases relating to hardware, software and documentation is controlled.

Ensure there is a proactive and comprehensive approach to risk management and be responsible for service continuity for own area.

Contribute to Root Cause Analysis (RCA) for allocated incidents and problems; instigating action when required, liaising with other team members and managers, as appropriate.

Business Continuity Management

Be familiar with the Trust and Department level Business Continuity Plan and personal responsibilities within, where applicable.

Person Specification

Qualifications

• University Degree in a related subject or demonstrable equivalent experience in developing Business Intelligence Solutions.
• UK Council for Health Informatics Professionals (UKCHIP) registration or equivalent.
• Microsoft certifications or equivalent technical qualifications.

Experience

• Substantial experience of design, build and deployment of Business Intelligence functions in a large/complex organisation.
• Substantial experience of SQL Server database/data warehouse development maintenance and support.
• Substantial experience of handling ETL solutions and issues across a range of systems.
• Substantial experience of delivering complex data and reporting projects.
• Experience in task resource estimation for sprint planning.
• Experience in creating and updating system documentation relating to Business Intelligence processes.
• Experience in developing data interchange processes using XML and JSON.
• Experience of successfully managing a number of equally important tasks to completion.
• Previous experience of working in the NHS.
• Data transfer using a web API.

Skills

• Creating well-structured SQL Server Integration Services packages for data transfer and Data Warehouse ETL processes.
• Designing and implementing SQL Server Reporting Services reports.
• Data transfer using XML and JSON.
• Developing custom SSIS Script Tasks/Components using C# to add non-standard functionality to SSIS Packages.
• Using Visual Studio for database and business intelligence development.
• Advanced T‑SQL query writing.
• Microsoft Excel.
• Ability to use own initiative, coach individuals and lead a project team engendering enthusiasm and commitment.
• Able to work to deadlines, prioritise and manage workload in a busy and changing environment.q
• Strong problem solving approach.
• Ability to work under pressure.
• Influencing and negotiating skills
• Ability to think creatively.
• Ability to explain complex technical issues to a non‑technical audience.
• Tableau.
• Power BI.
• SQL Server Analysis Services.
• MDX.
• R.
• Python.
• Source control using Visual Studio.
• Master Data Services.
• Business Intelligence Markup Language and BIML Express.

Knowledge

• Good knowledge of industry standard Data Warehouse design methodologies, i.e., Kimball.
• Best practices relating to the Microsoft SQL Server stack.
• NHS data dictionary and standards.

Values

• Ability to demonstrate the organisational values and behaviours

Other

• Evidence of continuing professional and personal development.
• Ability to travel to Christie managed sites as necessary.
• Ability to undertake shift working including out‑of‑hours, weekend and Public Holidays as required

Disclosure and Barring Service Check

This post is subject to the Rehabilitation of Offenders Act (Exceptions Order) 1975 and as such it will be necessary for a submission for Disclosure to be made to the Disclosure and Barring Service (formerly known as CRB) to check for any previous criminal convictions.

Business Intelligence & Software Development - E00413

£47,810 to £54,710 a yearper annum pro rata

Contract

Fixed term

Duration

12 months

Working pattern

Full-time

Reference number

413-101021-FB-MS

Job locations

Business Intelligence & Software Development - E00413