Data Engineer - Digital Archiving & Data Pipelines

The National Archives, UK; Greater London; Hybrid; GBP 43,000 - 45,000; Full time

Benefits offered by this job

Generous benefits package

Pension

Onsite gym

Discounts at on-site cafe

Training and development opportunities

Job summary

The National Archives is seeking a Data Engineer to join the Digital Archiving team. You will design scalable data pipelines, automate data processing, and build schemas to transform archival data for public access and discovery.

You will collaborate with product teams and archivists, using a modern stack including Python, SQL, XML, CSV and RDF to enable robust data-driven services across the nation.

Qualifications

• Large-scale data analysis experience with Python, SQL or XSLT.
• Knowledge of XML, CSV, JSON, RDF data formats.
• Experience with RDBMS, NoSQL or graph databases.
• Strong analytical and communication skills.

Responsibilities

• Design and develop scalable, repeatable data pipelines (ETL/ELT).
• Automate data cleansing, validation, standardisation and enrichment.
• Develop and document schemas, ontologies and models for archival data.
• Integrate data from diverse sources to support discovery and reuse.
• Collaborate with product teams, archivists and developers to deliver data-centric solutions.
• Contribute to a culture of openness, quality and continuous improvement.

Skills

Python

SQL

Shell scripting

XSLT

Tools

Talend

XSLT

Job description

The National Archives is seeking a Data Engineer to join the Digital Archiving team. You will design scalable data pipelines, automate data processing, and build schemas to transform archival data for public access and discovery.

You will collaborate with product teams and archivists, using a modern stack including Python, SQL, XML, CSV and RDF to enable robust data-driven services across the nation.