Data Consultant - DV CLEAR

Allscreens Nationwide Ltd; Corsham; Hybrid; GBP 70,000 - 110,000; Full time

Benefits offered by this job

Hybrid work model

Job summary

Allscreens Nationwide Ltd. seeks a Senior Data Consultant to lead delivery of secure data ingestion and integration pipelines, translating designs into working capability.

The role combines hands-on delivery oversight with mentoring Data Engineers, ensuring secure ETL/ELT pipelines across structured and unstructured data, in a highly regulated setting.

Qualifications

• Hands-on AWS delivery with secure engineering practices.
• Proven NiFi pipelines, processors, and monitoring experience.
• Experience with API and file-based integrations, legacy interfaces.
• Secure ETL/ELT pipelines for structured, semi-structured and unstructured data.
• MOD/Defence or secure government environments experience.
• Data mapping, schema management, and transformation logic.
• CI/CD, DevSecOps, source control, automated testing and release management.
• Ability to lead teams while resolving complex delivery issues.

Responsibilities

• Lead build, testing, assurance, deployment and handover of secure data pipelines into an AWS data lake.
• Translate architectures into practical delivery plans and work packages.
• Lead API-based, file-based, legacy and bespoke integrations using NiFi and AWS services.
• Onboard source systems with interface analysis, data mapping and security considerations.
• Define and coordinate testing (unit, integration, performance, security, operational).
• Lead defect triage, manage technical risks and resolve complex integration issues.
• Ensure pipelines include monitoring, logging, alerting, error handling and recovery logic.
• Coordinate assurance activities with cyber security and design authorities, produce runbooks and release notes.
• Mentor Data Engineers to maintain quality and delivery discipline.

Skills

AWS

Apache NiFi

API Integrations

ETL/ELT Pipelines

Security Compliance

Data Mapping & Schema

CI/CD / DevSecOps

Stakeholder Management

Tools

Terraform

CI/CD Tools

Docker

Kubernetes

Job description

Your new company

You will be working for a secure client delivering data engineering capability in a highly regulated environment. The client's identity will remain confidential at this stage.

Your new role

As Senior Data Consultant, you will lead the delivery of secure data ingestion and integration pipelines, translating the Data Architect's designs into working technical capability.

This is a technical leadership position combining hands‑on delivery oversight, pipeline implementation, test coordination, assurance support and service handover. You will lead day‑to‑day technical delivery and provide direction and mentoring to Data Engineers.

Key responsibilities

• Lead the build, testing, assurance, deployment and handover of secure data pipelines into an AWS data lake.
• Translate architectural designs into implementation plans, work packages and practical technical delivery approaches.
• Lead API‑based, file‑based, legacy and bespoke integrations using Apache NiFi and AWS services.
• Manage the onboarding of source systems, including interface analysis, data mapping, transformation rules and security considerations.
• Define and coordinate unit, integration, performance, security and operational acceptance testing.
• Lead defect triage, manage technical risks and resolve complex integration issues.
• Ensure pipeline solutions include monitoring, logging, alerting, error handling, retry logic and appropriate operational support procedures.
• Coordinate evidence for assurance and accreditation activities with cyber security teams and design authorities.
• Produce technical documentation, runbooks, release notes and service handover materials.
• Mentor and direct Data Engineers, maintaining technical quality and delivery discipline.

What you'll need to succeed

You will need active DV clearance, single UK nationality and experience delivering secure data engineering capability within MOD, Defence or another secure government environment. Experience working across different security classifications is mandatory.

Essential skills and experience

• Strong, hands‑on AWS delivery experience, including secure engineering practices and operational observability.
• Strong Apache NiFi experience, including pipelines, processors, controller services, flow governance and operational monitoring.
• Proven experience delivering API integrations, file‑based integrations, legacy system interfaces and bespoke data connectors.
• Experience building secure ETL and ELT pipelines for structured, semi‑structured and unstructured data.
• Experience within MOD, Defence or secure government environments involving different security classifications.
• Strong understanding of data mapping, schema management, transformation logic, validation, lineage and interface version control.
• Experience with CI/CD, DevSecOps, source control, automated testing and release management for data platforms.
• The ability to lead technical teams while remaining hands‑on enough to resolve complex delivery issues.
• Strong stakeholder management, technical communication and delivery governance skills.

Desirable skills and experience

• AWS Professional or Associate certification.
• Terraform or other Infrastructure as Code experience.
• Experience of containerisation, pipeline deployment automation and environment promotion.
• Experience with cross‑domain data transfer or controlled data movement between secure domains.
• Experience transitioning data platforms into live service or managed service support arrangements.

What you'll get in return

• The opportunity to lead the technical delivery of secure, enterprise‑scale data pipelines within an AWS environment.
• Hybrid working, with 2 to 3 days per week on site in either London or Corsham.
• IR35 status: To be confirmed.