National Defense Data Engineer — ETL & Big Data Pipelines

FedWriters, Inc.; Arlington (VA); On-site; USD 105,000 - 115,000; Full time

Benefits offered by this job

Health Insurance

Dental Insurance

Vision Insurance

Disability Insurance (long-term and/or

Disability Insurance

Life Insurance

401(k) Plan

Holiday Pay

Paid Time Off

Job summary

FedWriters, Inc. is seeking a Data Engineer to design end-to-end data pipelines for national defense initiatives. You will work with Databricks, Spark, Python, Scala, and Palantir Foundry to power decision-making for DoD missions from Arlington, VA.

You'll collaborate with cross-functional teams, implement ETL processes, ensure data quality and governance, and support scalable analytics for large datasets in a secure environment with a Secret clearance.

Qualifications

• 3-10 years of directly related experience and a B.A./B.S. or M.A./M.S. in a related field.
• 3+ years of experience as a Data Engineer.
• Proficiency in ETL processes and firsthand experience with technologies such as Databricks, Python, Spark, Scala, JavaScript/JSON, SQL, and Jupyter Notebooks.
• Experience working with large datasets and leveraging big data technologies to process and analyze data efficiently.
• Understanding of data modeling/visualization, database design principles, and data governance practices.
• Must possess an active Secret clearance at minimum.

Responsibilities

• Design, develop, and implement end-to-end data pipelines, utilizing ETL processes and technologies such as Databricks, Python, Spark, Scala, JavaScript/JSON, and SQL
• Work closely with cross-functional teams to understand data requirements and design optimal data models and architectures
• Create and optimize data pipelines from scratch, ensuring scalability, reliability, and high-performance processing
• Perform data cleansing, data integration, and data quality assurance activities to maintain the accuracy and integrity of large datasets
• Leverage big data technologies to efficiently process and analyze large datasets
• Collaborate with data scientists, analysts, and stakeholders to provide timely and accurate data insights and support decision-making processes
• Troubleshoot data-related problems and provide innovative solutions to address complex data challenges
• Implement and enforce data governance policies and procedures, ensuring compliance with regulatory requirements and industry best practices

Skills

Databricks

Python

Spark

Scala

JavaScript/JSON

SQL

Jupyter Notebooks

Data modeling

Data governance

Big data processing

Education

Bachelor's/Master's in a related field

Tools

Databricks

Palantir Foundry

Advana

War Data Platform

APIs

Jupyter Notebooks

Job description

FedWriters, Inc. is seeking a Data Engineer to design end-to-end data pipelines for national defense initiatives. You will work with Databricks, Spark, Python, Scala, and Palantir Foundry to power decision-making for DoD missions from Arlington, VA.

You'll collaborate with cross-functional teams, implement ETL processes, ensure data quality and governance, and support scalable analytics for large datasets in a secure environment with a Secret clearance.