Remote Data Pipeline Architect - NiFi/RDF SPARQL (Contract)

ISR RECRUITMENT LIMITED; United Kingdom; Remote; GBP 65,000 - 101,000; Part time

Benefits offered by this job

Remote work (UK-based)

Job summary

ISR RECRUITMENT LIMITED seeks a Data Pipeline Engineer / Data Pipeline Architect for a central government project. The role is remote (UK-based) and focuses on building an open-source, cloud-agnostic data transformation layer using NiFi, RDF, SPARQL, Python and Java.

You will create reusable pipelines, ensure data quality with testing, and support secure exchange between systems using open-source tools.

Qualifications

• Proven experience designing data integration or ETL solutions with Apache NiFi.
• Experience with RDF triples, SPARQL and semantic data modelling.
• Hands-on Python and Java development experience.
• Experience with APIs, databases, and file data sources.

Responsibilities

• Design and evolve the architecture of a reusable, cloud-agnostic data transformation platform.
• Build, test and maintain Apache NiFi flows, including integrations with APIs, databases, files and messaging systems.
• Develop pipelines to ingest, transform, validate and publish RDF triples, using SPARQL for querying and updates.
• Develop supporting components and integrations using Python and Java.
• Define data mappings, interface contracts, technical specifications and architectural decisions.
• Implement robust processing, including error handling, retries, duplicate management and recovery.
• Establish automated testing, monitoring, version control and repeatable deployment practices.
• Collaborate with architects, developers and stakeholders to translate requirements into working solutions.
• Produce clear technical documentation and support the delivery of reusable platform capabilities.

Skills

Apache NiFi

RDF triples

SPARQL

Python

Java

Data integration

CI/CD

Version control

Tools

Apache Jena

Kafka

SHACL

Docker

Kubernetes

Fuseki

Job description

ISR RECRUITMENT LIMITED seeks a Data Pipeline Engineer / Data Pipeline Architect for a central government project. The role is remote (UK-based) and focuses on building an open-source, cloud-agnostic data transformation layer using NiFi, RDF, SPARQL, Python and Java.

You will create reusable pipelines, ensure data quality with testing, and support secure exchange between systems using open-source tools.