Secure Data Engineer - ETL, Spark & Pipelines

Agile Defense, Inc.; Washington (District of Columbia); Sur place; USD 135 000 - 165 000; Plein temps

Résumé du poste

Agile Defense in Washington, DC is seeking a Data Engineer to design and maintain secure data pipelines and analytics-ready datasets. You will collaborate with data scientists, engineers, and mission stakeholders to process structured and unstructured data using Databricks, Spark, Palantir Foundry, or similar platforms, ensuring rigorous data quality and security.

The role requires a Bachelor's in a technical field, 3+ years of relevant experience, strong Python and SQL skills, and an active US

Qualifications

• Bachelor’s degree in a technical field or equivalent experience.
• 3+ years data engineering, software development, or analytics experience.
• Strong Python and SQL with data validation and modeling experience.
• Experience with ETL/ELT pipelines and data transformations.
• Familiarity with version control, testing, and Agile development.

Responsabilités

• Support the development and maintenance of secure data pipelines and analytics-ready datasets.
• Collaborate with data scientists, engineers, and stakeholders to process data using Databricks, Spark, Palantir Foundry, Maven Smart Systems, or comparable platforms.

Connaissances

Python

SQL

ETL/ELT

Data pipelines

Data modeling

Data validation

Version control

Agile

Stakeholder collaboration

Active clearance

Formation

Bachelor’s degree in computer science or related field

Outils

Databricks

Spark

Palantir Foundry

Maven Smart Systems

War Data Platform

Docker

CI/CD

MLflow

Terraform

AWS/Azure

Description du poste

Agile Defense in Washington, DC is seeking a Data Engineer to design and maintain secure data pipelines and analytics-ready datasets. You will collaborate with data scientists, engineers, and mission stakeholders to process structured and unstructured data using Databricks, Spark, Palantir Foundry, or similar platforms, ensuring rigorous data quality and security.

The role requires a Bachelor's in a technical field, 3+ years of relevant experience, strong Python and SQL skills, and an active US