Data Engineer for National Defense Data Pipelines

FWI (FedWriters, Inc.); Arlington (VA); On-site; USD 105,000 - 115,000; Full time

Benefits offered by this job

Health Insurance

Dental Insurance

Vision Insurance

Disability Insurance

Life Insurance

401(k) Plan

Holiday Pay

Paid Time Off

Job summary

FWI (FedWriters, Inc.) is seeking a Data Engineer to design and maintain end-to-end data pipelines for the DA2I program in support of the National Guard’s Minuteman Community Space. You will work with Databricks, Spark, Palantir Foundry, and a modern stack to enable data-driven decision making for national defense.

The role requires 3–10 years of related experience, active Secret clearance, and collaboration with cross-functional teams to model data and enforce governance.

Qualifications

• 3-10 years of directly related experience and a B.A./B.S. or M.A./M.S. in a related field
• 3+ years of experience as a Data Engineer
• Proficiency in ETL processes and firsthand experience with Databricks, Python, Spark, Scala, JavaScript/JSON, SQL, and Jupyter Notebooks
• Experience working with large datasets and leveraging big data technologies to process and analyze data efficiently
• Understanding of data modeling/visualization, database design principles, and data governance practices
• Must possess an active Secret clearance at minimum

Responsibilities

• Design, develop, and implement end-to-end data pipelines, utilizing ETL processes and technologies such as Databricks, Python, Spark, Scala, JavaScript/JSON, and SQL
• Work closely with cross-functional teams to understand data requirements and design optimal data models and architectures
• Create and optimize data pipelines from scratch, ensuring scalability, reliability, and high-performance processing
• Perform data cleansing, data integration, and data quality assurance activities to maintain the accuracy and integrity of large datasets
• Leverage big data technologies to efficiently process and analyze large datasets
• Collaborate with data scientists, analysts, and stakeholders to provide timely and accurate data insights and support decision-making processes
• Troubleshoot data-related problems and provide innovative solutions to address complex data challenges
• Implement and enforce data governance policies and procedures, ensuring compliance with regulatory requirements and industry best practices

Skills

ETL

Data pipelines

Databricks

Python

Spark

Scala

SQL

Jupyter

Data governance

Security clearance

Education

Bachelor’s or Master’s degree in related field

Tools

Palantir Foundry

Gaia

Ontology Manager

Workshop

Job description

FWI (FedWriters, Inc.) is seeking a Data Engineer to design and maintain end-to-end data pipelines for the DA2I program in support of the National Guard’s Minuteman Community Space. You will work with Databricks, Spark, Palantir Foundry, and a modern stack to enable data-driven decision making for national defense.

The role requires 3–10 years of related experience, active Secret clearance, and collaboration with cross-functional teams to model data and enforce governance.