Data Engineer - Onsite in Arlington | Databricks & Big Data

West 4th Strategy; Arlington, Northern (VA, KY); Hybrid; USD 155,000 - 165,000; Full time

Job summary

West 4th Strategy is seeking a Data Engineer to support the National Guard Bureau's Minuteman project, designing and maintaining the enterprise data environment on the central analytics platform. You will build end-to-end data pipelines using Databricks, Python, Spark, Scala, JavaScript/JSON, and SQL, collaborating with cross-functional teams to meet data requirements and enable insights.

The role involves onsite work in Arlington, VA 1–2 days per week, a required Active Secret clearance, and a

Qualifications

• 3–10 years of related experience.
• Onsite in Arlington, VA 1–2 days per week.
• 3+ years as a Data Engineer.
• Proficiency with ETL and Databricks, Python, Spark, Scala, JavaScript/JSON, SQL, and Jupyter Notebooks.
• Experience with large datasets and big data technologies.

Responsibilities

• Design, develop, and implement end-to-end data pipelines using ETL processes and technologies.
• Collaborate with cross-functional teams to understand data requirements and design data models.
• Create and optimize data pipelines for scalability and high performance.
• Perform data cleansing, data integration, and data quality assurance.
• Leverage big data technologies to process and analyze large datasets.
• Collaborate with data scientists and stakeholders to provide data insights.

Skills

Data governance

Data modeling

Data analysis

Education

B.A./B.S. or M.A./M.S. in a related field

Tools

Databricks

Python

Spark

Scala

JavaScript/JSON

SQL

Jupyter Notebooks

Job description

West 4th Strategy is seeking a Data Engineer to support the National Guard Bureau's Minuteman project, designing and maintaining the enterprise data environment on the central analytics platform. You will build end-to-end data pipelines using Databricks, Python, Spark, Scala, JavaScript/JSON, and SQL, collaborating with cross-functional teams to meet data requirements and enable insights.

The role involves onsite work in Arlington, VA 1–2 days per week, a required Active Secret clearance, and a