Data Engineer, Senior

Booz Allen Hamilton; Arlington (VA); On-site; USD 78,000 - 176,000; Full time

Job summary

Booz Allen Hamilton seeks a senior Data Engineer in Arlington, VA to design, build, and optimize data infrastructure using Palantir Foundry. You will transform highly unstructured sources into scalable, production‑ready pipelines powering advanced analytics and a force‑wide COP.

The role requires 5+ years in data engineering, PySpark, Python, and SQL, plus experience with Palantir Foundry and secure enclaves. TS/SCI clearance is required.

Qualifications

• 5+ years of experience in data engineering or big data.
• Experience with PySpark, Python, and SQL.
• Experience building complex data pipelines in distributed platforms such as Palantir Foundry.
• Knowledge of distributed systems and data governance in secure enclaves.

Responsibilities

• Architect, build, and maintain scalable ETL/ELT pipelines using Palantir Foundry.
• Design and optimize the Foundry Ontology for secure, structured data models.
• Engineer high‑performance data transformations in PySpark, Python, and SQL.
• Collaborate with data scientists to operationalize statistical models in production.

Skills

PySpark

Python

SQL

Data pipelines

Education

Bachelor's degree in Computer Science or Engineering

Tools

Palantir Foundry

CI/CD

Cloud architectures

Job description

Data Engineer, Senior

The Opportunity: We are seeking a highly technical and mission‑driven senior Data Engineer to design, build, and optimize data infrastructure for a Service-level Headquarters organization. In this role, you will leverage the Palantir Foundry ecosystem to transform highly unstructured, multi‑source data into scalable, production‑ready pipelines that power advanced analytics and a force-wide common operating picture (COP). You will architect and operationalize data solutions that enhance organizational insight into readiness, capacity, and force‑generation activities - helping senior leaders move from raw data to actionable, reliable information. This position is located in Arlington, VA.

What You’ll Work On:

• Architect, build, and maintain scalable ETL/ELT pipelines using Palantir Foundry, including Pipeline Builder and Code Repositories, to ingest and process highly unstructured data sources.
• Design, implement, and optimize the Foundry Ontology to ensure secure, logically structured data models that enable advanced analytics and Activity Based Intelligence (ABI).
• Engineer high‑performance transformation logic using PySpark, Python, and SQL tailored for distributed, large‑scale data processing.
• Collaborate with data scientists and analysts to operationalize statistical models and custom algorithms in secure production environments.
• Diagnose and resolve system bottlenecks, ensuring high performance across both cloud and classified compute environments.
• Establish data quality, validation frameworks, and automated pipeline monitoring to guarantee the integrity of inputs feeding analytics models.

You Have:

• 5+ years of experience with data engineering or big data
• Experience in PySpark, Python, and SQL
• Experience building complex data pipelines and transformations within distributed platforms such as Palantir Foundry
• Experience structuring, formatting, and optimizing large-scale datasets for consumption by engineering teams and mathematical or statistical models
• Knowledge of distributed systems, data warehousing concepts, and data governance in secure enclaves
• TS/SCI clearance
• Bachelor’s degree in Computer Science or Engineering

Nice If You Have:

• Experience with AWS, Azure, or similar cloud computing architectures supporting large data platforms
• Experience processing and scaling geospatial datasets for intelligence or operational mapping
• Experience with CI/CD pipelines and version control best practices
• Experience with DoW Global Force Management policies and processes
• Knowledge of mathematical modeling and statistical analysis frameworks
• Knowledge of DoW institutional datasets such as War Data Platform

Compensation

At Booz Allen, we celebrate your contributions, provide you with opportunities and choices, and support your total well-being. Our offerings include health, life, disability, financial, and retirement benefits, as well as paid leave, professional development, tuition assistance, work-life programs, and dependent care. Our recognition awards program acknowledges employees for exceptional performance and superior demonstration of our values. Full-time and part-time employees working at least 20 hours a week on a regular basis are eligible to participate in Booz Allen’s benefit programs. Individuals that do not meet the threshold are only eligible for select offerings, not inclusive of health benefits. We encourage you to learn more about our total benefits by visiting the Resource page on our Careers site and reviewing Our Employee Benefits page. Salary at Booz Allen is determined by various factors, including but not limited to location, the individual’s particular combination of education, knowledge, skills, competencies, and experience, as well as contract-specific affordability and organizational requirements. The projected compensation range for this position is $77,600.00 to $176,000.00 (annualized USD). The estimate displayed represents the typical salary range for this position and is just one component of Booz Allen’s total compensation package for employees. This posting will close within 90 days from the Posting Date.

Identity Statement

As part of the hiring process, we will ask you to complete an identity verification process that leverages advanced biometrics and artificial intelligence to ensure authenticity and protect against identity fraud. You are expected to be on camera during interviews and assessments. We reserve the right to take your picture to verify your identity and prevent fraud.

Candidate AI Usage Policy

AI is a part of our daily work at Booz Allen, and we are committed to the responsible and ethical use of AI tools. However, we want to ensure a fair candidate process based on your own skills and knowledge. As part of this commitment, the use of artificial intelligence (AI) or other tools to assist with responses during interviews (whether in-person or virtual) is prohibited unless permission is explicitly provided.

Work Model

Our people-first culture prioritizes the benefits of collaboration. To support engagement and effective communication, employees working virtually are generally expected to have their cameras on during meetings. Remote: If this position is listed as remote, there may still be occasions when you are required to work in person at a Booz Allen or customer facility. Hybrid: If this position is listed as hybrid, you will be expected to work from a Booz Allen or customer facility, in alignment with your leadership's expectations and the needs of the role. Onsite: If this position is listed as onsite, work will primarily be performed full-time at a customer facility, where employees will collaborate directly with colleagues and customers as required by the role.

Commitment to Non-Discrimination

All qualified applicants will receive consideration for employment without regard to disability, status as a protected veteran or any other status protected by applicable federal, state, local, or international law.

About Booz Allen

Booz Allen is an advanced technology company. We build commercial‑grade products and solutions for America’s most critical defense, civil, and national security priorities.

Know Your Rights Poster Accommodations

Applicants who need a reasonable accommodation for any part of the application, hiring, or employment process because of a disability, a sincerely held religious belief, practice, or observance, or as otherwise required by applicable law should contact the Booz Allen Help Desk by calling 1-877-927-8278 or sending an email to [e-mail]. We will review requests on an individualized basis and provide reasonable accommodations consistent with applicable law.

Data Privacy

For more information on how Booz Allen uses your information, please see our Careers Privacy Policy.