Data Engineer - Databricks Pipelines for National Guard

careers-fedwriters; Bailey's Crossroads (VA); Hybrid; USD 115,000 - 125,000; Full time

Benefits offered by this job

Health Insurance

Dental Insurance

Vision Insurance

Long-term and Short-term Disability

Life Insurance

401(k) Plan

Holiday Pay

Paid Time Off

Job summary

FWI is hiring a Data Engineer to design, build, and maintain enterprise data pipelines for the National Guard analytics program, using Databricks, Spark, and SQL to enable governance and scalable analytics.

Based in the National Capital Region with a hybrid schedule (1–2 days on site), you will partner with data scientists, analysts, and government stakeholders to deliver timely, accurate data for decision support while upholding regulatory and security requirements.

Qualifications

• Active DoD Secret clearance (final, in current scope).
• Bachelor's or Master's degree in a related field.
• 3+ years of directly related experience as a Data Engineer.
• Proficiency in ETL processes with Databricks, Python, Spark, Scala, JavaScript/JSON, SQL, and Jupyter Notebooks.
• Demonstrated experience with large datasets and big data technologies.
• Knowledge of data modeling, visualization, governance, and regulatory practices.
• Based in the National Capital Region or willing to relocate, able to report to Arlington site.
• U.S. citizenship is required for the clearance.

Responsibilities

• Design, develop, and implement end-to-end data pipelines using ETL processes and technologies including Databricks, Python, Spark, Scala, JavaScript/JSON, and SQL
• Build and optimize pipelines from scratch with scalability, reliability, and high-performance processing
• Collaborate with cross-functional teams to understand data requirements and design models/architectures
• Perform data cleansing, integration, and quality assurance on large datasets
• Apply big data technologies to process and analyze data efficiently
• Partner with data scientists, analysts, and government stakeholders to deliver timely, accurate data for decision-making
• Troubleshoot complex data problems and develop practical solutions
• Implement and enforce data governance policies ensuring regulatory compliance

Skills

Databricks

Python

Spark

Scala

JavaScript/JSON

SQL

Jupyter Notebooks

Education

Bachelor's or Master's degree in a related field

Tools

Databricks

Palantir Foundry

Jupyter Notebooks

Job description

FWI is hiring a Data Engineer to design, build, and maintain enterprise data pipelines for the National Guard analytics program, using Databricks, Spark, and SQL to enable governance and scalable analytics.

Based in the National Capital Region with a hybrid schedule (1–2 days on site), you will partner with data scientists, analysts, and government stakeholders to deliver timely, accurate data for decision support while upholding regulatory and security requirements.