Data Engineer - Secure Pipelines for DoD Missions

Agile Defense, LLC; Washington (District of Columbia); On-site; USD 135,000 - 165,000; Full time

Job summary

Agile Defense, LLC seeks a Data Engineer to build and maintain secure data pipelines for DoD missions, working with data scientists, engineers, and stakeholders to process structured and unstructured data using Databricks, Spark, Palantir Foundry, Maven Smart Systems, or similar platforms.

Bachelor's in a technical field, 3+ years of relevant experience, strong Python/SQL skills, and an active US security clearance are required. Onsite SCIF facilities are required.

Qualifications

• Bachelor's degree in a related technical field; equivalent combinations of education, technical certification, and relevant professional experience may be considered.
• 3+ years of relevant data engineering, software development, data analytics, or enterprise-platform experience.
• Experience with Python and SQL familiarity with data validation, data modeling, and data-quality practices; familiarity with Spark, PySpark, Databricks, or comparable technologies
• Experience supporting ETL/ELT pipelines and data transformations
• Understanding of version control, testing, documentation, and Agile development
• Ability to collaborate with technical and nontechnical stakeholders
• Active US government security clearance

Responsibilities

• Supports the development and maintenance of secure data pipelines, ETL/ELT workflows, and analytics-ready datasets.
• Works with data scientists, engineers, and mission stakeholders to process structured and unstructured data using Databricks, Spark, Palantir Foundry, Maven Smart Systems, or comparable platforms.

Skills

Data pipelines

Python

SQL

Spark/PySpark/Databricks

ETL/ELT

Agile collaboration

Security clearance

Version control/testing

Education

Bachelor's degree in a technical field

Tools

Palantir Foundry

Databricks

Maven Smart Systems

War Data Platform

Docker

AWS/Azure

Job description

Agile Defense, LLC seeks a Data Engineer to build and maintain secure data pipelines for DoD missions, working with data scientists, engineers, and stakeholders to process structured and unstructured data using Databricks, Spark, Palantir Foundry, Maven Smart Systems, or similar platforms.

Bachelor's in a technical field, 3+ years of relevant experience, strong Python/SQL skills, and an active US security clearance are required. Onsite SCIF facilities are required.