Lead Data Engineer

Searchability NS&D; Gloucester; Hybrid; GBP 70,000 - 95,000; Full time

Benefits offered by this job

Competitive salary

6% bonus

25 days holiday

Clearance bonus

Job summary

A leading National Security Organisation is seeking a Lead Data Engineer in Gloucester. Your role will involve developing data solutions with cutting-edge technologies while ensuring data quality and security. Candidates must have active eDV clearance and experience in SQL, NoSQL, and ETL processes. This position offers a competitive salary and a hybrid working model.

Qualifications

• Active eDV clearance (West) is mandatory.
• Experience with data pipelines and ETL processing required.
• Strong communication skills to manage stakeholder expectations.

Responsibilities

• Design and maintain data pipelines and solutions.
• Develop data-streaming and ETL solutions.
• Monitor and optimize system performance.
• Ensure data quality, security, and performance optimization.
• Lead and support discussions with senior stakeholders and teams.
• Decompose user needs into epics and stories.

Skills

Data Engineering

SQL

NoSQL

ETL

Apache

Team Leadership

Python

Java

Groovy

NI Fi

Tools

Apache NiFi

MongoDB

Python

Java

Job description

3 days ago Be among the first 25 applicants

This range is provided by Searchability NS&D. Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.

Base pay range

Direct message the job poster from Searchability NS&D

Lead Consultant placing Security Cleared DevOps, Cloud, Data, Cyber, and Infrastructure candidates in the Southwest

New Permanent Opportunity available with a leading National Security Organisation for an eDV cleared Lead Data Engineer in Gloucester

• Gloucester location – hybrid working when possible
• Must hold active Enhanced DV Clearance (West)
• Competitive Salary DOE - 6% bonus, 25 days holiday, clearance bonus
• Experience in Data Pipelines, ETL processing, Data Integration, Apache, SQL/NoSQL, Team Leadership

Who Are We?

Our client is a trusted and growing supplier to the National Security sector, delivering mission-critical solutions that help keep the nation safe, secure, and prosperous. You’ll work with cutting-edge technologies, including AI/Data Science, Cyber, Cloud, DevOps/SRE, and Platform Engineering. They have long-term contracts secured across the latest customer framework and are set for significant growth.

What will the Lead Data Engineer be Doing?

You will develop mission-critical data solutions for National Security clients, working with cutting-edge technologies such as AI/DS, Cyber, Cloud, DevOps/SRE, and Platform Engineering. You'll collaborate directly with customers across National Security, Defence, and Intelligence to solve complex, high-stakes challenges. The role involves designing and implementing sophisticated data pipelines to connect operational systems with analytics and business intelligence platforms.

Responsibilities include:

• Design, build, and maintain data pipelines, including ingestion, orchestration, and enrichment
• Develop data-streaming and ETL solutions (e.g. NiFi)
• Model databases and integrate data from diverse sources
• Ensure data quality, consistency, and security
• Monitor and optimise system performance
• Apply systems integration expertise within agile teams
• Decompose user needs into epics and stories
• Promote reuse of data flows and best practices across teams

The Lead Data Engineer Should Have:

• Active eDV clearance (West)
• Willingness to work full-time on-site in Gloucester when required.

Required experience in the following:

• SQL and NoSQL databases (e.g. MongoDB)
• ETL processing languages such as Groovy, Python or Java
• Understand and interpret technical and business stakeholder needs
• Manage expectations through clear, proactive communication
• Lead and support challenging conversations with teams and senior stakeholders

To be Considered:

Please either apply by clicking online or emailing me directly to [e-mail]. For further information please call me on 0161 416 6800 / 07719065951 - I can make myself available outside of normal working hours to suit from 7am until 10pm. If unavailable, please leave a message and either myself or one of my colleagues will respond. By applying for this role, you give express consent for us to process & submit (subject to required skills) your application to our client in conjunction with this vacancy only. Also feel free to follow me on Twitter @SearchableHenry or connect with me on LinkedIn, just search Henry Clay-Davies (searchability). I look forward to hearing from you.

KEY SKILLS:

DATA ENGINEER / DATA ENGINEERING / DEFENCE / NATIONAL SECURITY / DATA STRATEGY / DATA PIPELINES / DATA GOVERNANCE / SQL / NOSQL / APACHE / NIFI / KAFKA / ETL / GLOUCESTER / DV / SECURITY CLEARED / DV CLEARANCE

Seniority level

• Seniority level

  Mid-Senior level

Employment type

• Employment type

  Full-time

Job function

• Job function

  Information Technology and Consulting

• Industries

  Data Infrastructure and Analytics, Technology, Information and Media, and Information Services

Referrals increase your chances of interviewing at Searchability NS&D by 2x

Sign in to set job alerts for “Data Engineer” roles.

Gloucestershire, England, United Kingdom 4 days ago

Gloucestershire, England, United Kingdom 2 months ago

Worcester, England, United Kingdom 3 days ago

Gloucester, England, United Kingdom 4 hours ago

Worcester, England, United Kingdom 1 month ago

Stroud, England, United Kingdom 4 hours ago

Gloucester, England, United Kingdom 1 week ago

Gloucestershire, England, United Kingdom 4 days ago

System Reliability Engineer - Quantum Computing

Cambridge, England, United Kingdom 6 months ago

Software Support Engineer - Labyrinth Screening

Gloucester, England, United Kingdom 2 days ago

Gloucestershire, England, United Kingdom 1 week ago

Stroud, England, United Kingdom 3 weeks ago

Cambridge, England, United Kingdom 6 months ago

Cambridge, England, United Kingdom 1 month ago

Brockworth, England, United Kingdom 2 weeks ago

Research Software Engineer - Quantum Software

Cambridge, England, United Kingdom 2 months ago

Gloucester, England, United Kingdom 5 months ago

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.