Data Engineer - Onsite (Secret Clearance)

Agile Defense; Town of Florida (NY); On-site; USD 110,000 - 140,000; Full time

Job summary

Agile Defense is seeking a Data Engineer to design and maintain secure data pipelines and analytics-ready datasets supporting our government missions. The role collaborates with data scientists, engineers, and stakeholders to process structured and unstructured data using Databricks, Spark, Palantir Foundry, and related platforms.

On-site work is required in SCIF environments, and candidates must be U.S. citizens with an active security clearance.

Qualifications

• Bachelor's degree or equivalent in a technical field.
• 3+ years of data engineering or related experience.
• Proficiency in Python and SQL; experience with Spark, PySpark, Databricks.
• Experience supporting ETL/ELT pipelines and data transformations.
• Understanding of version control, testing, documentation, and Agile development.
• Ability to collaborate with technical and nontechnical stakeholders.
• Active US government security clearance.

Responsibilities

• Supports the development and maintenance of secure data pipelines, ETL/ELT workflows, and analytics-ready datasets.
• Works with data scientists, engineers, and mission stakeholders to process structured and unstructured data using Databricks, Spark, Palantir Foundry, Maven Smart Systems, or comparable platforms.

Skills

Python

SQL

Databricks

Spark

ETL/ELT

Data modeling

Data quality

Version control

Agile

Security clearance

Education

Bachelor's degree in computer science, data science, engineering, information systems, mathematics, or a related technical field

Tools

Palantir Foundry

Maven Smart Systems

War Data Platform

Databricks

Docker

Job description

Agile Defense is seeking a Data Engineer to design and maintain secure data pipelines and analytics-ready datasets supporting our government missions. The role collaborates with data scientists, engineers, and stakeholders to process structured and unstructured data using Databricks, Spark, Palantir Foundry, and related platforms.

On-site work is required in SCIF environments, and candidates must be U.S. citizens with an active security clearance.