Data Engineer

St George's University Hospitals; Camden Town; On-site; GBP 45,000 - 60,000; Full time

Job summary

A leading NHS Foundation Trust based in Camden Town seeks a Data Engineer to support data management and analytics. The successful candidate will design scalable data platforms and maintain the data warehouse, ensuring data integrity and compliance with standards. This role requires strong expertise in Azure solutions and data engineering principles. Join a dedicated team committed to delivering high-quality health services to a large population.

Qualifications

• Strong expertise in data engineering and building data solutions.
• Experience with Azure cloud services and data management.
• Knowledge of NHS Information Standards and data quality.

Responsibilities

• Design scalable cloud data platforms for the Trust.
• Implement and maintain data pipelines and ETL processes.
• Provide technical leadership and advise on best practices.

Skills

Data Engineering

Azure Data Factory

ETL processes

Data Warehousing

Data Modelling

Tools

Azure

Microsoft Fabric

Synapse Analytics

Job description

Overview

Data Engineering Team supports decision-making within the Trust through the provision of a comprehensive information and analysis service by managing and optimizing the flow, storage, and accessibility of data from clinical-on-clinical systems within the Trust. The post holder plays a pivotal role in ensuring that data flows smoothly, remains consistent, and is available for decision-making, insights and analytics. The post holder will contribute to the smooth transition of the onsite data warehouse solutions into a more efficient, scalable and secure cloud infrastructure while supporting the current data platform and infrastructure. The post holder plays a pivotal role in ensuring that data flows smoothly, remains consistent, and is available for decision-making, insights and analytics. The post holder will also be responsible for maintaining the current data warehouse solutions by ensuring operational efficiency, routine maintenance, issue resolution, monitoring and reporting. As a member of the Trust\'s Data Engineering team, this role serves as a strategic and architectural expert in the development and maintenance of the data warehouse and its associated systems and solutions.

Responsibilities

• Deliver the trust\'s future data landscape by designing scalable and reliable data platforms on cloud infrastructure, ensuring data integrity and supporting continuous delivery of data solutions.
• Design, development, and implement scalable and efficient data pipelines and workflows using Azure Data Factory and other ETL tools.
• Build and manage data lakes, warehouse and databases on Azure including Synapse Analytics, Azure Data Lake and Azure SQL Database and develop our future data processing solutions in Microsoft Fabric.
• Take full ownership of assigned responsibilities across advisory, implementation, and review phases, engaging effectively with both technical teams and senior leadership.
• Act as an internal technical leader and innovator, contributing to the development of advanced and tailored technical solutions for the trust while championing engineering excellence.
• Collaborate with wider IDT team including analysts, back office and other stakeholders to understand requirements and translate them into effective solutions.
• Provide technical support for the existing database applications.
• Design, develop, and implement new data feeds, ETL processes, and data marts to support evolving analytical and reporting needs.
• Proactively review new and emerging technologies and their potential benefit to the Trust, fostering a culture of innovation and continuous improvement.
• Develop solutions and provide management for the implementation of NHS Information Standards, mapping data standards and implementation of common data models.
• Maintain robust data modelling practices, collaborate with other team members for best practices.
• Ensure compliance with NHS Information Standard Notices (ISNs) and data standards.
• Develop algorithms to transform data into usable models and ensure data quality and integrity.
• Maintain and support the current data warehousing infrastructure to support the reporting needs of the Trust by managing various extraction, transformation, and load (ETL) processes.
• Provide advanced technical knowledge and skills to support the information needs of the Trust.
• Ensure accuracy and timeliness of data and adhere to security and Information Governance policies and procedures.
• Act as a team leader and provide deputising support to the Data Engineering Manager as required.
• To diagnose complex problems, situations and/or information and make informed judgements to formulate solutions and recommend/decide on best course of action.
• Ensure all technical processes, current and future are documented.
• Where necessary, advise and guide colleagues on technical and best practice matters.

Working for our organisation

St George\'s University Hospitals NHS Foundation Trust is one of the country\'s principal teaching hospitals and our main site is shared with St George\'s, University of London, which trains medical students and carries out advanced medical research. We have over 9,000 dedicated staff serving a population of 1.3 million across south-west London. We deliver a large number of services, such as cardiothoracic medicine and surgery, neurosciences and renal transplantation. We also cover significant populations from Surrey and Sussex, totalling around 3.5 million people. As well as acute hospital services, we provide a wide variety of specialist care and a range of community services to patients.