Senior Data Engineer — End-to-End Pipelines & Big Data

West 4th Strategy; Virginia (MN); On-site; USD 155,000 - 165,000; Full time

Job summary

West 4th Strategy is hiring a Data Engineer to support the National Guard Bureau's Minuteman project team in Arlington, VA. You will design and maintain end-to-end data pipelines using Databricks, Python, Spark, Scala, JavaScript/JSON, and SQL, collaborating with data scientists and analysts to deliver reliable data solutions.

The role requires 3–10 years of related experience, on-site presence, and an active security clearance.

Qualifications

• Minimum 3–10 years of directly related experience.
• Onsite work in Arlington, VA 1–2 days per week.
• Proficient in ETL with Databricks, Python, Spark, Scala, JavaScript/JSON, SQL and Jupyter Notebooks.
• Experience with large datasets, data modeling, governance and visualization.

Responsibilities

• Design and implement end-to-end data pipelines using ETL technologies.
• Collaborate with cross-functional teams to define data requirements and models.
• Create scalable, high-performance data pipelines and data quality checks.
• Apply data governance policies and ensure regulatory compliance.
• Maintain and optimize databases and data infrastructures for mission needs.
• Support data scientists and analysts with timely, accurate data insights.

Skills

ETL processes

Big data experience

Data governance

Data modeling

Cross-functional collaboration

Education

B.A./B.S. or M.A./M.S. in a related field

Tools

Databricks

Python

Spark

Scala

JavaScript/JSON

SQL

Jupyter Notebooks

Job description

West 4th Strategy is hiring a Data Engineer to support the National Guard Bureau's Minuteman project team in Arlington, VA. You will design and maintain end-to-end data pipelines using Databricks, Python, Spark, Scala, JavaScript/JSON, and SQL, collaborating with data scientists and analysts to deliver reliable data solutions.

The role requires 3–10 years of related experience, on-site presence, and an active security clearance.