Cleared Data Engineer

careers-fedwriters; Bailey's Crossroads (VA); On-site; USD 105,000 - 115,000; Full time

Benefits offered by this job

Health Insurance

Dental Insurance

Vision Insurance

Long-term Disability Insurance

Short-term Disability Insurance

Life Insurance

401(k) Plan

Holiday Pay

Paid Time Off

Job summary

FWI in Arlington, VA seeks a Data Engineer to design and build end‑to‑end data pipelines powering national defense decision‑making. You will work with Databricks, Spark, Python, SQL, and Palantir Foundry to transform raw data into actionable insights.

This full‑time role requires 3–10 years of related experience and an active Secret clearance. You’ll collaborate with cross‑functional teams, enforce data governance, and optimize large datasets for performance and reliability, making a direct

Qualifications

• 3–10 years of directly related experience and a BA/BS or MA/MS in a related field.
• 3+ years of experience as a Data Engineer.
• Proficiency in ETL processes and technologies such as Databricks, Python, Spark, Scala, JavaScript/JSON, SQL, and Jupyter Notebooks.
• Experience with large datasets and big data technologies to process and analyze data efficiently.
• Understanding of data modeling/visualization, database design principles, and data governance practices.
• Must possess an active Secret clearance at minimum.

Responsibilities

• Design, develop, and implement end-to-end data pipelines using ETL and technologies such as Databricks, Python, Spark, Scala, JavaScript/JSON, and SQL.
• Work closely with cross-functional teams to understand data requirements and design optimal data models and architectures.
• Create and optimize data pipelines from scratch, ensuring scalability, reliability, and high-performance processing.
• Perform data cleansing, data integration, and data quality assurance for large datasets.
• Leverage big data technologies to efficiently process and analyze large datasets.
• Collaborate with data scientists, analysts, and stakeholders to provide timely data insights and support decision-making.
• Troubleshoot data-related problems and provide innovative solutions to address complex data challenges.
• Implement and enforce data governance policies and procedures, ensuring regulatory compliance and industry best practices.

Skills

Databricks

Python

SQL

Spark

ETL

Jupyter Notebooks

Big data

Data governance

Security clearance

Education

BA/BS or MA/MS in related field

Tools

Databricks

Python

Spark

Scala

JavaScript/JSON

SQL

Jupyter Notebooks

Palantir Foundry

Workshop

Ontology Manager

Gaia

Advana

Job description

Overview

Ready to build data infrastructure that actually matters to national defense? As FWI's Data Engineer on the DA2I program, you'll architect end-to-end pipelines using Databricks, Spark, and Palantir Foundry that power decision‑making for the National Guard's Minuteman Community Space. If you want your ETL and big‑data skills to support a real DoW mission, not just another dashboard, this is the seat.

FWI is building a team to support the National Guard Bureau's (NGB) Minuteman Community Space and as a Data Engineer, you will play a crucial role in designing, developing, and maintaining the Minuteman Community Space's data infrastructure and systems, using ETL, Databricks, Python, Spark, Scala, JavaScript/JSON, and SQL to ensure efficient data processing and analysis.

Work Schedule and Location:

This full‑time position will work Monday through Friday, in Arlington, VA.

Responsibilities

• Design, develop, and implement end‑to‑end data pipelines, utilizing ETL processes and technologies such as Databricks, Python, Spark, Scala, JavaScript/JSON, and SQL
• Work closely with cross‑functional teams to understand data requirements and design optimal data models and architectures
• Create and optimize data pipelines from scratch, ensuring scalability, reliability, and high‑performance processing
• Perform data cleansing, data integration, and data quality assurance activities to maintain the accuracy and integrity of large datasets
• Leverage big data technologies to efficiently process and analyze large datasets
• Collaborate with data scientists, analysts, and stakeholders to provide timely and accurate data insights and support decision‑making processes
• Troubleshoot data‑related problems and provide innovative solutions to address complex data challenges
• Implement and enforce data governance policies and procedures, ensuring compliance with regulatory requirements and industry best practices

Qualifications

Required Qualifications:

• 3-10 years of directly related experience and a B.A./B.S. or M.A./M.S. in a related field
• 3+ years of experience as a Data Engineer
• Proficiency in ETL processes and firsthand experience with technologies such as Databricks, Python, Spark, Scala, JavaScript/JSON, SQL, and Jupyter Notebooks
• Experience working with large datasets and leveraging big data technologies to process and analyze data efficiently
• Understanding of data modeling/visualization, database design principles, and data governance practices
• Must possess an active Secret clearance at minimum

Preferred Qualifications:

• Experience with the DoW mission and associated datasets
• Previous experience with Advana or the War Data Platform
• Experience with APIs
• Experience with Machine Learning models and/or Generative AI
• Experience building within Palantir Foundry applications, including Workshop, Ontology Manager, and Gaia

FWI is an Equal Opportunity Employer, including disability/vets.

Why Join Our Team

At FWI, we place the highest importance on creating an exceptional employee experience. You'll have opportunities to achieve your career aspirations through internal promotions, professional development, and other recognition and rewards programs. Join our team and take advantage of the many benefits we offer, including:

• Health Insurance
• Dental Insurance
• Vision Insurance
• Long‑term and Short‑term Disability Insurance
• Life Insurance
• 401(k) Plan
• Holiday Pay
• Paid Time Off

Pay Range

105-115k per year