Data Engineer - St. Louis

Agile Defense, Inc.; O'Fallon (IL); On-site; USD 135,000 - 165,000; Full time

Job summary

Agile Defense, Inc. in O'Fallon, IL (SCIF) seeks a Data Engineer to build and maintain secure data pipelines and analytics-ready datasets. You will work with data scientists, engineers, and mission stakeholders to process structured and unstructured data using Databricks, Spark, Palantir Foundry, Maven Smart Systems, or comparable platforms.

This role requires a U.S. citizen with an active Secret clearance (higher levels possible) and 3+ years of relevant experience in Python, SQL, ETL/ELT, and

Qualifications

• Bachelor's degree in a technical field or equivalent experience.
• 3+ years of data engineering, software development, or analytics experience.
• Proficient in Python and SQL with data validation and modeling skills.
• Experience with ETL/ELT pipelines and data transformations.
• Familiarity with Spark, Databricks, and related technologies.
• Strong collaboration with technical and nontechnical stakeholders.
• Active US government security clearance (Secret or higher).

Responsibilities

• Develop and maintain secure data pipelines and analytics datasets.
• Collaborate with data scientists, engineers, and mission stakeholders.
• Process structured and unstructured data using Databricks, Spark, or comparable platforms.

Skills

Data engineering

Python

SQL

ETL/ELT

Agile

Security clearance

Collaboration

Education

Bachelor's degree in Computer Science or related field

Tools

Databricks

Spark

Palantir Foundry

Maven Smart Systems

Docker

AWS/Azure

Job description

About Agile Defense

At Agile Defense we know that action defines the outcome and new challenges require new solutions. That’s why we always look to the future and embrace change with an unmovable spirit and the courage to build for what comes next.

Our vision is to bring adaptive innovation to support our nation's most important missions through the seamless integration of advanced technologies, elite minds, and unparalleled agility—leveraging a foundation of speed, flexibility, and ingenuity to strengthen and protect our nation’s vital interests.

Job Title: Data Engineer

Location: O'Fallon (St. Louis), IL: Scott AFB

Clearance Level: This position requires candidates to be U.S. citizens and to possess, at minimum, an active Secret security clearance. Roles under this requisition may require higher-level clearances, including TS/SCI, which candidates must be able to obtain and maintain based on project assignment.

Job Description

Supports the development and maintenance of secure data pipelines, ETL/ELT workflows, and analytics-ready datasets. Works with data scientists, engineers, and mission stakeholders to process structured and unstructured data using Databricks, Spark, Palantir Foundry, Maven Smart Systems, or comparable platforms.

Required Skills

• Bachelor’s degree in computer science, data science, engineering, information systems, mathematics, or a related technical field. Equivalent combinations of education, technical certification, and relevant professional experience may be considered.


• 3+ years of relevant data engineering, software development, data analytics, or enterprise-platform experience.


• Experience with Python and SQL familiarity with data validation, data modeling, and data-quality practices; familiarity with Spark, PySpark, Databricks, or comparable technologies


• Experience supporting ETL/ELT pipelines and data transformations


• Understanding of version control, testing, documentation, and Agile development


• Ability to collaborate with technical and nontechnical stakeholders


• Active US government security clearance

Preferred Skills

• Experience with Palantir Foundry, Maven Smart Systems, or War Data Platform


• Exposure to Docker, CI/CD, MLflow, APIs, or Terraform


• Familiarity with AWS or Azure


• Familiarity with DoD data environments and classified networks


• Prior Combatant Command support


• Solid Python and SQL skills with familiarity in JavaScript/TypeScript

Working Conditions

Must be able to work onsite in a SCIF

$135,000 - $165,000 a year

Our Core Values

Employees of Agile Defense are our number one priority, and the importance we place on our culture here is fundamental. Our culture is alive and evolving, but it always stays true to its roots. Here, you are valued as a family member, and we believe that we can accomplish great things together. Agile Defense has been highly successful in the past few years due to our employees and the culture we create together.

What makes us Agile? We call it the 6Hs, the values that define our culture and guide everything we do. Together, these values infuse vibrancy, integrity, and a tireless work ethic into advancing the most important national security and critical civilian missions. It's how we show up every day. It's who we are.

• Happy - Be Infectious. Happiness multiplies and creates a positive and connected environment where motivation and satisfaction have an outsized effect on everything we do.


• Helpful - Be Supportive. Being helpful is the foundation of teamwork, resulting in a supportive atmosphere where collaboration flourishes, and collective success is celebrated.


• Honest - Be Trustworthy. Honesty serves as our compass, ensuring transparent communication, and ethical conduct, essential to who we are and the complex domains we support.


• Humble - Be Grounded. Success is not achieved alone, humility ensures a culture of mutual respect, encouraging open communication, and a willingness to learn from one another and take on any task.


• Hungry - Be Eager. Our hunger for excellence drives an insatiable appetite for innovation and continuous improvement, propelling us forward in the face of new and unprecedented challenges.


• Hustle - Be Driven. Hustle is reflected in our relentless work ethic, where we are each committed to going above and beyond to advance the mission and achieve success.

Equal Opportunity Employer/Protected Veterans/Individuals with Disabilities