Data Engineer - Digital Archiving Pipelines

National Archives and Records Administration; Richmond; Hybrid; GBP 41,000 - 50,000; Full time

Benefits offered by this job

Pension

Onsite gym

Onsite cafe discounts

Training & development

Annual leave 22 days

Job summary

The National Archives is hiring a Data Engineer to design and build scalable data pipelines, automate data processing, and model archival data for improved public access. You’ll work in a collaborative, modern tech stack and contribute to data-centric solutions across teams.

This full-time role offers hybrid working with 60% on-site at Kew, flexible options, and opportunities to advance skills in XML/JSON/RDF, SQL, and graph databases while shaping the nation’s memory through digital archiving.

Qualifications

• Experience designing and building scalable data pipelines (ETL/ELT) for large datasets.
• Strong knowledge of data formats (XML, CSV, JSON, RDF) and database technologies (RDBMS, NoSQL, graph databases).
• Excellent analytical and communication skills; able to explain technical issues to non-technical colleagues.

Responsibilities

• Design and develop scalable, repeatable data pipelines to process, transform and load archival data.
• Automate data cleansing, validation, standardisation and enrichment.
• Develop and document schemas, ontologies and models for archival data.
• Integrate data from diverse sources and formats to support discovery and reuse.
• Collaborate with product teams, archivists and developers to deliver data-centric solutions.
• Contribute to a culture of openness, quality and continuous improvement.

Skills

Shell scripting

SQL

XSLT

Python

XML

JSON

RDBMS

NoSQL

Graph databases

Tools

Talend

XML processing

RDF tooling

Job description

The National Archives is hiring a Data Engineer to design and build scalable data pipelines, automate data processing, and model archival data for improved public access. You’ll work in a collaborative, modern tech stack and contribute to data-centric solutions across teams.

This full-time role offers hybrid working with 60% on-site at Kew, flexible options, and opportunities to advance skills in XML/JSON/RDF, SQL, and graph databases while shaping the nation’s memory through digital archiving.