Data Engineer - Secure Data Pipelines (Secret)

Agile Defense, LLC; O'Fallon (IL); On-site; USD 135,000 - 165,000; Full time

Job summary

Agile Defense, LLC is seeking a Data Engineer to support secure data pipelines and analytics-ready datasets for high-stakes national security missions.

You'll collaborate with data scientists, engineers, and mission stakeholders, leveraging Databricks, Spark, Palantir Foundry, and related platforms in a SCIF onsite environment. A active US government security clearance is required, with opportunities across multiple locations.

Qualifications

• Bachelor's degree in computer science or related field
• 3+ years of data engineering, software development, data analytics, or enterprise-platform experience
• Proficiency in Python and SQL; familiarity with Spark, PySpark, Databricks
• Experience supporting ETL/ELT pipelines and data transformations
• Understanding of version control, testing, documentation, and Agile development
• Ability to collaborate with technical and nontechnical stakeholders
• Active US government security clearance

Responsibilities

• Supports the development and maintenance of secure data pipelines, ETL/ELT workflows, and analytics-ready datasets
• Works with data scientists, engineers, and mission stakeholders to process structured and unstructured data using Databricks, Spark, Palantir Foundry, Maven Smart Systems, or comparable platforms

Skills

Python

SQL

Spark

Databricks

ETL/ELT

Agile development

Stakeholder collaboration

Version control

Security clearance

Education

Bachelor's degree in computer science or related field

Tools

Palantir Foundry

Maven Smart Systems

Docker

CI/CD

MLflow

APIs

Terraform

AWS

Azure

Job description

Agile Defense, LLC is seeking a Data Engineer to support secure data pipelines and analytics-ready datasets for high-stakes national security missions.

You'll collaborate with data scientists, engineers, and mission stakeholders, leveraging Databricks, Spark, Palantir Foundry, and related platforms in a SCIF onsite environment. A active US government security clearance is required, with opportunities across multiple locations.