Senior Data Engineer: Secure Federal Pipelines

metaphaseconsulting; Washington (District of Columbia); Hybrid; USD 120,000 - 165,000; Full time

Job summary

MetaPhase Consulting delivers mission-focused work in a secure Federal environment, seeking a Senior Data Engineer with 10+ years of experience to design scalable pipelines and analytic data products. You will translate diverse data into governed, high-performing assets supporting visual analytics and decision making.

Join a team that collaborates with analysts, engineers, and mission users to deliver reliable data solutions.

Qualifications

• 10+ years of relevant experience in data engineering, data architecture, data integration, or a closely related technical discipline.
• Bachelor’s degree in computer science, data science, information systems, engineering, mathematics, or a related field.
• Active Top Secret clearance with eligibility for SCI access. U.S. Citizenship is required.
• Advanced proficiency in Python, SQL, and database development, with hands-on experience designing relational data stores and optimizing data-processing performance.
• Experience building and operating ETL or ELT pipelines, including batch and streaming data processing, data validation, error handling, and monitoring.
• Experience integrating diverse data sources and managing data quality, metadata, lineage, access controls, and security requirements in a Federal or similarly regulated environment.

Responsibilities

• Design, develop, and optimize batch and real-time data pipelines that ingest, validate, transform, and publish structured, semi-structured, and unstructured data.
• Build and maintain large-scale relational databases, cloud storage, and data models that support high-performance web and desktop visual analytic applications.
• Develop ETL and ELT processes, data-quality checks, metadata, lineage, and monitoring that make complex data reliable and usable across the mission lifecycle.
• Engineer scalable data services, APIs, and curated datasets that enable bulk analysis of relationships, advanced graphics, visualization, and high-performance computing workloads.
• Optimize query performance, database structures, indexing, and data-processing workflows while integrating new sources with existing warehouse and analytic environments.
• Collaborate directly with analysts, software engineers, architects, and mission users to refine data requirements, test delivered capabilities, and improve data products through iterative delivery.
• Apply secure engineering practices for data access, auditability, configuration management, and operational resilience across open-source, COTS, and GOTS technologies.

Skills

Python

SQL

Data modeling

ETL/ELT pipelines

Education

Bachelor's degree in CS/DS/IS/engineering/math

Tools

PostgreSQL

OpenSearch/Elasticsearch

Apache Kafka

Apache NiFi

Cribl

Docker

Kubernetes

Job description

MetaPhase Consulting delivers mission-focused work in a secure Federal environment, seeking a Senior Data Engineer with 10+ years of experience to design scalable pipelines and analytic data products. You will translate diverse data into governed, high-performing assets supporting visual analytics and decision making.

Join a team that collaborates with analysts, engineers, and mission users to deliver reliable data solutions.