Secure Data Engineer - ETL, Spark & Databricks

Socket.dev; Colorado Springs (CO); On-site; USD 110,000 - 140,000; Full time

Job summary

Agile Defense is seeking a Data Engineer to support secure data pipelines and analytics-ready datasets. You will collaborate with data scientists, engineers, and mission stakeholders to process structured and unstructured data using Databricks, Spark, Palantir Foundry, and related platforms.

The role requires a strong foundation in Python/SQL, ETL/ELT development, and Agile practices, with a focus on security clearance and DoD-related environments.

Qualifications

• Bachelor’s degree in computer science, data science, engineering, information systems, mathematics, or related field; equivalents considered.
• 3+ years of data engineering, software development, data analytics, or enterprise-platform experience.

Responsibilities

• Supports the development and maintenance of secure data pipelines, ETL/ELT workflows, and analytics-ready datasets.
• Works with data scientists, engineers, and mission stakeholders to process structured and unstructured data using Databricks, Spark, Palantir Foundry, Maven Smart Systems, or comparable platforms.

Skills

3+ years experience

Python

SQL

Data validation

ETL/ELT pipelines

Version control

Testing

Agile development

Stakeholder collaboration

Active US security clearance

Education

Bachelor's degree in CS/DS/Engineering/Math

Tools

Palantir Foundry

Maven Smart Systems

War Data Platform

Docker

CI/CD

MLflow

APIs

Terraform

AWS

Azure

Job description

Agile Defense is seeking a Data Engineer to support secure data pipelines and analytics-ready datasets. You will collaborate with data scientists, engineers, and mission stakeholders to process structured and unstructured data using Databricks, Spark, Palantir Foundry, and related platforms.

The role requires a strong foundation in Python/SQL, ETL/ELT development, and Agile practices, with a focus on security clearance and DoD-related environments.