Secure Data Engineer — ETL, Spark, Databricks (SCIF onsite)

Agile Defense, LLC; Tampa (FL); On-site; USD 135,000 - 165,000; Full time

Job summary

Agile Defense, LLC is seeking a Data Engineer to join our team at MacDill AFB, Tampa, FL. This onsite role requires an active Secret clearance and the ability to build secure data pipelines and analytics-ready datasets in collaboration with mission stakeholders.

You will work with Databricks, Spark, Palantir Foundry, and related platforms to process structured and unstructured data, supporting DoD-aligned data environments while adhering to agile practices and documentation standards.

Qualifications

• Bachelor's degree in a technical field or equivalent experience.
• 3+ years in data engineering, software development, or analytics.
• Proficient in Python and SQL with data validation and modeling.
• Experience with ETL/ELT pipelines and data transformations.
• Familiar with Agile methodologies and documentation practices.
• Ability to work with technical and nontechnical stakeholders.
• Active US government security clearance

Responsibilities

• Develop and maintain secure data pipelines, ETL/ELT workflows, and analytics-ready datasets.
• Collaborate with data scientists, engineers, and mission stakeholders to process data using Databricks, Spark, Palantir Foundry, Maven Smart Systems or comparable platforms.

Skills

Python

SQL

ETL/ELT

Data modeling

Data quality

Agile development

Stakeholder collaboration

Security clearance

Education

Bachelor's degree in a technical field

Tools

Databricks

Spark

PySpark

Palantir Foundry

Maven Smart Systems

Docker

CI/CD

MLflow

Terraform

AWS

Azure

Job description

Agile Defense, LLC is seeking a Data Engineer to join our team at MacDill AFB, Tampa, FL. This onsite role requires an active Secret clearance and the ability to build secure data pipelines and analytics-ready datasets in collaboration with mission stakeholders.

You will work with Databricks, Spark, Palantir Foundry, and related platforms to process structured and unstructured data, supporting DoD-aligned data environments while adhering to agile practices and documentation standards.