Data Engineer, Senior

Booz Allen Hamilton; Cambridgeshire and Peterborough; Hybrid; USD 77,000 - 176,000; Full time

Job summary

A leading consulting firm in the UK is seeking a Data Management Engineer to develop and maintain data pipelines for optimizing data workflows. This role involves collaboration with military personnel and policymakers to support mission objectives. Strong programming skills in Java and Python along with TS/SCI clearance are essential. The position offers competitive compensation and a hybrid work environment.

Benefits

Health and life insurance

Paid leave

Professional development

Tuition assistance

Work-life programs

Qualifications

• 5+ years of experience with data engineering or in a data science environment.
• Experience with Java and Python.
• Experience with designing custom tools for data workflows.

Responsibilities

• Apply data engineering best practices to collect, process, and store data.
• Develop and maintain data pipelines for ETL of structured and unstructured data.
• Collaborate with stakeholders to identify and address data-related needs.

Skills

Data engineering

Java

Python

NLP

Machine Learning

Databricks

Spark

Data pipeline development

Project management

TS/SCI clearance

Education

Bachelor's degree in Mathematics, Statistics, Engineering, or Data Science

Master’s degree in relevant field

Tools

Databricks

Spark

AI and ML tools

Job description

Your growth matters to us - explore our career development opportunities.

BE EMPOWERED TO SUCCEED

Connect with others in our people-first culture and enhance our collective ingenuity.

SUPPORT YOUR WELLBEING

Learn how we’ll support you as you pursue a balanced, fulfilling life.

YOUR CANDIDATE JOURNEY

Discover what to expect during your journey as a candidate with us.

As a Data Management Engineer, you will apply data engineering best practices to support the collection, processing, and storage of Publicly Available Information (PAI) and other datasets. You will develop and maintain data pipelines to extract, transform, and load (ETL) structured and unstructured data, ensuring compliance with data security, regulatory, and quality standards. Your role will involve cleaning, organizing, integrating, and maintaining data models and visualizations to enhance operational analysis and decision-making.

You will collaborate with stakeholders—including military personnel, partner nations, and policymakers—to identify and address data-related needs. By conducting large-scale data queries and synthesizing results, you will provide actionable insights that support mission objectives. Leveraging programming and scripting tools such as Java, Python, or R, you will automate data processes and design scalable data models, schemas, and structures to optimize performance. Your expertise will ensure adherence to U.S. Intelligence Community (IC) and Department of Defense (DoD) guidelines and security measures when handling both classified and unclassified data.

Additionally, you will develop and deliver reports, dashboards, and briefings for the client and other stakeholders while participating in U.S. and foreign partner meetings and committees as a subject matter expert in data analysis and PAI. You will also support the testing and evaluation of analytical tools and software, operating within a managed attribution system as required for mission activities.

Join us. The world can’t wait.

You Have:

5+ years of experience with data engineering or in a data science environment, including supporting large data, multi-INT analytics, NLP, ML, and automated analytics

Experience with Java and Python

Experience with using Databricks and Spark for data processing

Experience with designing custom tools and using scripting or programming languages to optimize data mining, cleaning, validation, and analysis workflows

Experience in working collaboratively with the US Intelligence Community (IC) and DoD Joint structure

Knowledge of geo-enabled datasets and their application in mission contexts

Knowledge of automation, artificial intelligence, and machine learning tools and techniques

Ability to manage multiple projects under tight deadlines

TS/SCI clearance

Nice If You Have:

Experience with building or supporting cloud-based data solutions in secure environments

Experience with applying AI and ML to intelligence problems

Experience with integrating structured and unstructured data via APIs or other ingestion methods

Experience with Defense Intelligence Enterprise data tools and platforms

Experience supporting intelligence analysis or data analysis related to African political, security, or socio-economic issues

Experience in working with cross-functional teams and engaging mission stakeholders

Experience with developing or maintaining data governance, QA, or metadata strategies in operational environments

Knowledge of IC data standards, oversight policies, and messaging formats, including ICD-501, ICD-203, or ICD-206

Ability to design and implement custom data solutions or analytics pipelines for large, mission-specific datasets

Bachelor's degree in Mathematics, Statistics, Engineering, or Data Science preferred; Master’s degree in Mathematics, Statistics, Engineering, Data Science, or a related fielda plus

Clearance:

Applicants selected will be subject to a security investigation and may need to meet eligibility requirements for access to classified information; TS/SCI clearance is required.

Compensation

At Booz Allen, we celebrate your contributions, provide you with opportunities and choices, and support your total well-being. Our offerings include health, life, disability, financial, and retirement benefits, as well as paid leave, professional development, tuition assistance, work-life programs, and dependent care. Our recognition awards program acknowledges employees for exceptional performance and superior demonstration of our values. Full-time and part-time employees working at least 20 hours a week on a regular basis are eligible to participate in Booz Allen’s benefit programs. Individuals that do not meet the threshold are only eligible for select offerings, not inclusive of health benefits. We encourage you to learn more about our total benefits by visiting the Resource page on our Careers site and reviewing Our Employee Benefits page.

Salary at Booz Allen is determined by various factors, including but not limited to location, the individual’s particular combination of education, knowledge, skills, competencies, and experience, as well as contract-specific affordability and organizational requirements. The projected compensation range for this position is $77,500.00 to $176,000.00 (annualized USD). The estimate displayed represents the typical salary range for this position and is just one component of Booz Allen’s total compensation package for employees. This posting will close within 90 days from the Posting Date.

Data Engineer, Senior

The Opportunity:

As a Data Management Engineer, you will apply data engineering best practices to support the collection, processing, and storage of Publicly Available Information (PAI) and other datasets. You will develop and maintain data pipelines to extract, transform, and load (ETL) structured and unstructured data, ensuring compliance with data security, regulatory, and quality standards. Your role will involve cleaning, organizing, integrating, and maintaining data models and visualizations to enhance operational analysis and decision-making.

You will collaborate with stakeholders—including military personnel, partner nations, and policymakers—to identify and address data-related needs. By conducting large-scale data queries and synthesizing results, you will provide actionable insights that support mission objectives. Leveraging programming and scripting tools such as Java, Python, or R, you will automate data processes and design scalable data models, schemas, and structures to optimize performance. Your expertise will ensure adherence to U.S. Intelligence Community (IC) and Department of Defense (DoD) guidelines and security measures when handling both classified and unclassified data.

Additionally, you will develop and deliver reports, dashboards, and briefings for the client and other stakeholders while participating in U.S. and foreign partner meetings and committees as a subject matter expert in data analysis and PAI. You will also support the testing and evaluation of analytical tools and software, operating within a managed attribution system as required for mission activities.

Join us. The world can’t wait.

You Have:

• 5+ years of experience with data engineering or in a data science environment, including supporting large data, multi-INT analytics, NLP, ML, and automated analytics

• Experience with Java and Python

• Experience with using Databricks and Spark for data processing

• Experience with designing custom tools and using scripting or programming languages to optimize data mining, cleaning, validation, and analysis workflows

• Experience in working collaboratively with the US Intelligence Community (IC) and DoD Joint structure

• Knowledge of geo-enabled datasets and their application in mission contexts

• Knowledge of automation, artificial intelligence, and machine learning tools and techniques

• Ability to manage multiple projects under tight deadlines

• TS/SCI clearance

• Bachelor's degree

Nice If You Have:

• Experience with building or supporting cloud-based data solutions in secure environments

• Experience with applying AI and ML to intelligence problems

• Experience with integrating structured and unstructured data via APIs or other ingestion methods

• Experience with Defense Intelligence Enterprise data tools and platforms

• Experience supporting intelligence analysis or data analysis related to African political, security, or socio-economic issues

• Experience in working with cross-functional teams and engaging mission stakeholders

• Experience with developing or maintaining data governance, QA, or metadata strategies in operational environments

• Knowledge of IC data standards, oversight policies, and messaging formats, including ICD-501, ICD-203, or ICD-206

• Ability to design and implement custom data solutions or analytics pipelines for large, mission-specific datasets

• Bachelor's degree in Mathematics, Statistics, Engineering, or Data Science preferred; Master’s degree in Mathematics, Statistics, Engineering, Data Science, or a related fielda plus

Clearance:

Applicants selected will be subject to a security investigation and may need to meet eligibility requirements for access to classified information; TS/SCI clearance is required.

Compensation

At Booz Allen, we celebrate your contributions, provide you with opportunities and choices, and support your total well-being. Our offerings include health, life, disability, financial, and retirement benefits, as well as paid leave, professional development, tuition assistance, work-life programs, and dependent care. Our recognition awards program acknowledges employees for exceptional performance and superior demonstration of our values. Full-time and part-time employees working at least 20 hours a week on a regular basis are eligible to participate in Booz Allen’s benefit programs. Individuals that do not meet the threshold are only eligible for select offerings, not inclusive of health benefits. We encourage you to learn more about our total benefits by visiting the Resource page on our Careers site and reviewing Our Employee Benefits page.

Salary at Booz Allen is determined by various factors, including but not limited to location, the individual’s particular combination of education, knowledge, skills, competencies, and experience, as well as contract-specific affordability and organizational requirements. The projected compensation range for this position is $77,500.00 to $176,000.00 (annualized USD). The estimate displayed represents the typical salary range for this position and is just one component of Booz Allen’s total compensation package for employees. This posting will close within 90 days from the Posting Date.

Identity Statement

As part of the application process, you are expected to be on camera during interviews and assessments. We reserve the right to take your picture to verify your identity and prevent fraud.

Work Model
Our people-first culture prioritizes the benefits of flexibility and collaboration, whether that happens in person or remotely.

• If this position is listed as remote or hybrid, you’ll periodically work from a Booz Allen or client site facility.
• If this position is listed as onsite, you’ll work with colleagues and clients in person, as needed for the specific role.

Commitment to Non-Discrimination

All qualified applicants will receive consideration for employment without regard to disability, status as a protected veteran or any other status protected by applicable federal, state, local, or international law.