Senior Data Engineer - DoD Health Data Pipelines

Systems Planning and Analysis, Inc.; Falls Church (VA); On-site; USD 156,000 - 179,000; Full time

Job summary

Intrepid, an SPA Company, is seeking a Senior Data Engineer to build and orchestrate enterprise data pipelines for the Military Health System, joining a team serving DHA and DoD customers. You will transform diverse health data into reliable, scalable data products using Spark and Databricks, with API-based integrations and governance practices.

The role requires DoD-level security clearance, a strong background in Python/SQL, and experience mentoring engineers while collaborating with

Qualifications

• Active DoD Secret clearance required.
• Master's degree in CS/IS/SE or related field.
• 10+ years in data or software engineering.
• Proficient in Python and SQL for data pipelines.
• Strong Spark experience for large-scale processing.
• Experience with Databricks or similar platforms.
• Design and maintain ETL/ELT pipelines.
• Data modeling, governance, and quality practices.
• Experience API integrations and data sharing.
• Experience with Git-based development workflows and tooling.
• Excellent written and verbal communication with stakeholders.
• Ability to navigate ambiguity and manage risk.

Responsibilities

• Design, build, and operate scalable data pipelines and data products.
• Lead integration of data from diverse DoD and health systems.
• Develop API-based data exchange and ingestion approaches.
• Promote reusable data engineering patterns and standards.
• Provide architecture guidance and mentorship to the team.
• Monitor and optimize production data workflows for reliability.
• Enforce data validation, quality, and governance practices.
• Troubleshoot complex data integration challenges and root causes.
• Collaborate with engineers, architects, analysts, and stakeholders.

Skills

Active DoD Secret clearance

Python

SQL

Apache Spark

Databricks

ETL/ELT design

Data modeling

APIs integration

Git-based workflows

Mentoring

Stakeholder comms

Security/compliance awareness

Education

Master's degree in Computer Science or related field

Tools

Databricks

GitLab

Palantir Foundry

Job description

Intrepid, an SPA Company, is seeking a Senior Data Engineer to build and orchestrate enterprise data pipelines for the Military Health System, joining a team serving DHA and DoD customers. You will transform diverse health data into reliable, scalable data products using Spark and Databricks, with API-based integrations and governance practices.

The role requires DoD-level security clearance, a strong background in Python/SQL, and experience mentoring engineers while collaborating with