Data Engineer - Secret Clearance & Secure Pipelines

Agile Defense, LLC; Waipahu (HI); On-site; USD 135,000 - 165,000; Full time

Job summary

Agile Defense, LLC is seeking a Data Engineer to support secure data pipelines and analytics-ready datasets for mission-critical programs. You will work with data scientists and engineers to process structured and unstructured data using Databricks, Spark, Palantir Foundry, or similar platforms.

U.S. citizenship with an active Secret clearance is required, and on-site work in a SCIF is expected. Strong Python and SQL, data modeling, ETL/ELT, and Agile development experience are essential.

Qualifications

• Bachelor's degree in a technical field or equivalent experience.
• 3+ years of data engineering, software development, or analytics work.
• Strong Python and SQL skills with data validation, modeling, and quality practices; familiarity with Spark / Databricks.
• Experience supporting ETL/ELT pipelines and data transformations.
• Knowledge of version control, testing, documentation, and Agile development.
• Ability to collaborate with technical and non-technical stakeholders.
• Active US government security clearance.

Responsibilities

• Supports the development and maintenance of secure data pipelines and analytics-ready datasets.
• Collaborates with data scientists, engineers, and mission stakeholders to process data using Databricks, Spark, Palantir Foundry, Maven Smart Systems, or similar platforms.

Skills

Python

SQL

Spark

Databricks

ETL/ELT

Data modeling

Data quality

Git

Agile development

Stakeholder collaboration

Education

Bachelor's degree in CS or related field

Tools

Palantir Foundry

Maven Smart Systems

War Data Platform

Docker

CI/CD

MLflow

APIs

Terraform

AWS

Azure

Job description

Agile Defense, LLC is seeking a Data Engineer to support secure data pipelines and analytics-ready datasets for mission-critical programs. You will work with data scientists and engineers to process structured and unstructured data using Databricks, Spark, Palantir Foundry, or similar platforms.

U.S. citizenship with an active Secret clearance is required, and on-site work in a SCIF is expected. Strong Python and SQL, data modeling, ETL/ELT, and Agile development experience are essential.