Hybrid Data Engineer: Archival Data Pipelines & Enrichment

The National Archives; Greater London; Hybrid; GBP 38,000 - 52,000; Full time

Benefits offered by this job

Generous pension

Onsite gym

Discounts at on-site cafe

Training and development

Job summary

The National Archives in London is looking for a Data Engineer to join the Digital Archiving team. You will design and build scalable data pipelines, automate data processing, and develop tools to enrich and integrate archival data.

This full-time, hybrid role at Kew offers the chance to work with modern tech stacks and contribute to public access to national records. You will collaborate with archivists and developers to deliver practical data-centric solutions, while improving data quality and

Qualifications

• Strong experience in large-scale data analysis and manipulation using Python, SQL, and shell scripting.
• Solid understanding of data formats (XML, CSV, JSON, RDF) and related database technologies.
• Excellent analytical, problem-solving, and communication skills.
• Ability to work collaboratively in multidisciplinary teams and explain technical issues to non-technical colleagues.

Responsibilities

• Design and develop scalable, repeatable data pipelines (ETL/ELT) to process, transform and load archival data.
• Automate data cleansing, validation, standardisation, enrichment, and transformation.
• Develop and document schemas, ontologies, and models for archival data.
• Integrate data from diverse sources and formats to support better discovery and reuse.
• Collaborate with product teams, archivists and developers to deliver data-centric solutions.
• Contribute to a culture of openness, quality, and continuous improvement.

Skills

Python

SQL

Shell scripting

XSLT

Tools

RDBMS

NoSQL

Graph databases

Job description

The National Archives in London is looking for a Data Engineer to join the Digital Archiving team. You will design and build scalable data pipelines, automate data processing, and develop tools to enrich and integrate archival data.

This full-time, hybrid role at Kew offers the chance to work with modern tech stacks and contribute to public access to national records. You will collaborate with archivists and developers to deliver practical data-centric solutions, while improving data quality and