Top Secret Data Engineer: Pipelines, Catalogs & Governance

Partner Forces; Arlington, Northern (VA, KY); Hybrid; USD 110,000 - 150,000; Full time

Job summary

Partner Forces is seeking a hands-on Data Engineer to support a federal cybersecurity client. You will design and optimize data pipelines, integrate multiple data sources, and build scalable data platforms while ensuring data is organized, discoverable, and trusted.

You will work with cloud environments (Azure/AWS/GCP), implement metadata catalogs, and collaborate with stakeholders to deliver data-driven solutions for analytics and mission capabilities.

Qualifications

• US Citizen with an active Top Secret clearance.
• 3 to 7 years of data engineering or metadata engineering experience.
• Experience designing ETL/ELT pipelines and data integration.
• Strong SQL skills and database knowledge; data modeling and governance.

Responsibilities

• Design, build, and optimize scalable data pipelines and ETL/ELT processes.
• Integrate structured and unstructured data from multiple sources.
• Build data models, warehouses, lakes, and lakehouse environments.
• Develop monitoring to improve reliability, performance, and quality.
• Maintain metadata repositories and data catalogs for discoverability.
• Support metadata collection, classification, and enrichment.
• Establish data lineage and governance practices with stakeholders.
• Collaborate with cloud teams in Azure/AWS/GCP for data environments.
• Identify data quality improvements and drive practical solutions.
• Partner with mission stakeholders to translate needs into technical solutions.
• Support analytics, reporting, AI/ML, and mission capabilities.

Skills

US Citizenship

Top Secret clearance

ETL/ELT design

SQL

Data pipelines

Cloud platforms

Data modeling

Metadata management

Data governance

Tools

Azure

AWS

GCP

Job description

Partner Forces is seeking a hands-on Data Engineer to support a federal cybersecurity client. You will design and optimize data pipelines, integrate multiple data sources, and build scalable data platforms while ensuring data is organized, discoverable, and trusted.

You will work with cloud environments (Azure/AWS/GCP), implement metadata catalogs, and collaborate with stakeholders to deliver data-driven solutions for analytics and mission capabilities.