Data Engineer (Various Locations)

Agile Defense; Town of Florida (NY); On-site; USD 110,000 - 140,000; Full time

Job summary

Agile Defense is seeking a Data Engineer to design and maintain secure data pipelines and analytics-ready datasets supporting our government missions. The role collaborates with data scientists, engineers, and stakeholders to process structured and unstructured data using Databricks, Spark, Palantir Foundry, and related platforms.

On-site work is required in SCIF environments, and candidates must be U.S. citizens with an active security clearance.

Qualifications

• Bachelor's degree or equivalent in a technical field.
• 3+ years of data engineering or related experience.
• Proficiency in Python and SQL; experience with Spark, PySpark, Databricks.
• Experience supporting ETL/ELT pipelines and data transformations.
• Understanding of version control, testing, documentation, and Agile development.
• Ability to collaborate with technical and nontechnical stakeholders.
• Active US government security clearance.

Responsibilities

• Supports the development and maintenance of secure data pipelines, ETL/ELT workflows, and analytics-ready datasets.
• Works with data scientists, engineers, and mission stakeholders to process structured and unstructured data using Databricks, Spark, Palantir Foundry, Maven Smart Systems, or comparable platforms.

Skills

Python

SQL

Databricks

Spark

ETL/ELT

Data modeling

Data quality

Version control

Agile

Security clearance

Education

Bachelor's degree in computer science, data science, engineering, information systems, mathematics, or a related technical field

Tools

Palantir Foundry

Maven Smart Systems

War Data Platform

Databricks

Docker

Job description

At Agile Defense we know that action defines the outcome and new challenges require new solutions. That’s why we always look to the future and embrace change with an unmovable spirit and the courage to build for what comes next.

Our vision is to bring adaptive innovation to support our nation's most important missions through the seamless integration of advanced technologies, elite minds, and unparalleled agility—leveraging a foundation of speed, flexibility, and ingenuity to strengthen and protect our nation’s vital interests.

Job Title: Data Engineer

Location: On-Site, Various Locations (see below)

• Peterson Space Force Base, CO
• Stuttgart, Germany: Patch Barracks, Kelley Barracks
• Falls Church, VA
• Ft. Meade, MD
• Tampa, FL: MacDill AFB
• Doral (Miami), FL: SOUTHCOM HQ
• Honolulu, HI: Camp H.M. Smith
• Arlington, VA Pentagon
• O'Fallon (St. Louis), IL: Scott AFB
• Omaha, NE: Offutt AFB
• Colorado Springs, CO: Peterson SFB

Clearance Level: This position requires candidates to be U.S. citizens and to possess, at minimum, an active Secret security clearance. Roles under this requisition may require higher-level clearances, including TS/SCI, which candidates must be able to obtain and maintain based on project assignment.

About Agile Defense

At Agile Defense we know that action defines the outcome and new challenges require new solutions. That’s why we always look to the future and embrace change with an unmovable spirit and the courage to build for what comes next.

Our vision is to bring adaptive innovation to support our nation's most important missions through the seamless integration of advanced technologies, elite minds, and unparalleled agility—leveraging a foundation of speed, flexibility, and ingenuity to strengthen and protect our nation’s vital interests.

Job Description

Supports the development and maintenance of secure data pipelines, ETL/ELT workflows, and analytics-ready datasets. Works with data scientists, engineers, and mission stakeholders to process structured and unstructured data using Databricks, Spark, Palantir Foundry, Maven Smart Systems, or comparable platforms.

Required Skills

• Bachelor’s degree in computer science, data science, engineering, information systems, mathematics, or a related technical field. Equivalent combinations of education, technical certification, and relevant professional experience may be considered
• 3+ years of relevant data engineering, software development, data analytics, or enterprise-platform experience
• Experience with Python and SQL familiarity with data validation, data modeling, and data-quality practices; familiarity with Spark, PySpark, Databricks, or comparable technologies
• Experience supporting ETL/ELT pipelines and data transformations
• Understanding of version control, testing, documentation, and Agile development
• Ability to collaborate with technical and nontechnical stakeholders
• Active US government security clearance

Preferred Skills

• Experience with Palantir Foundry, Maven Smart Systems, or War Data Platform
• Exposure to Docker, CI/CD, MLflow, APIs, or Terraform
• Familiarity with AWS or Azure
• Familiarity with DoD data environments and classified networks
• Prior Combatant Command support
• Solid Python and SQL skills with familiarity in JavaScript/TypeScript

Working Conditions

Must be able to work onsite in a SCIF

Our Core Values

• Happy - Be Infectious.
• Helpful - Be Supportive.
• Honest - Be Trustworthy.
• Humble - Be Grounded.
• Hungry - Be Eager.
• Hustle - Be Driven.

Equal Opportunity Employer/Protected Veterans/Individuals with Disabilities

We may use artificial intelligence (AI) tools to support parts of the hiring process, such as reviewing applications, analyzing resumes, or assessing responses and identifying potential inconsistencies or verification signals in application materials based on available information. These tools assist our recruitment team but do not replace human judgment. Final hiring decisions are ultimately made by humans. If you would like more information about how your data is processed, please contact us.