Data Engineering Developer: Secure DoD Data Pipelines

TDI (Tetrad Digital Integrity); Washington (District of Columbia); On-site; USD 130,000 - 145,000; Full time

Job summary

Tetrad Digital Integrity (TDI) is seeking a Data Engineering Software Developer to support a new Agile team in federal IT modernization. This onsite role in the Washington, DC area offers a ground-floor opportunity to architect, build, and integrate cutting-edge data infrastructure for DoD missions.

The candidate will design and operate scalable data pipelines, leverage Kafka, Elastic, AWS, and OpenShift, and collaborate with analysts to deliver secure, compliant analytics and dashboards.

Qualifications

• Active DoD TS/SCI security clearance and ability to pass suitability screening.
• Current Security+ or equivalent/higher.
• Bachelor’s degree in CS/Engineering and 8+ years of experience.
• Hands-on experience designing, building, and maintaining data pipelines (ETL/ELT) and integrating multiple, disparate data sources.
• Experience with data warehouse and/or data lake technologies (e.g., AWS Redshift, S3, Hadoop, Snowflake, or similar).
• Proficiency with data engineering tools and languages such as Python, Java, SQL, and shell scripting.
• Experience with Elastic Stack (Elasticsearch, Logstash, Kibana) and/or Kafka for data ingestion and processing.
• Familiarity with network operations data (logs, metrics, events, ticketing, CMDB) and related data models.
• Experience with Linux/UNIX system administration and automation.
• Knowledge of data security, access controls, and compliance frameworks (DoD, DISA, RMF, STIGs).
• Experience with CI/CD pipelines, containerized pipelines, version control (Git, Bitbucket), and DevOps practices.

Responsibilities

• Designs, builds, and maintains scalable, reliable data systems and pipelines to ingest, process, and transform large data sources for analytics and reporting.
• Unifies and integrates data from multiple network operations systems into a consistent platform, ensuring data quality, security, and DoD/DISA compliance.
• Implements solutions using Confluent Kafka, Elastic Stack, AWS, and OpenShift (Kubernetes); creates pipelines and supports Kibana visualizations.
• Develops and manages data warehouses and data lakes to support analytics and dashboards; optimizes infrastructure for performance and cost-efficiency.
• Optimizes ingestion throughput, query performance, indexing strategies, and storage across Elastic and Kafka platforms.
• Automates ETL/ELT processes, data validation, cleansing, monitoring; supports CI/CD pipelines for build, test, deploy.
• Collaborates with data analysts, visualization engineers, and stakeholders to deliver integrated data solutions and documents architecture and procedures.
• Troubleshoots data ingestion, processing, and platform performance issues.

Skills

Data pipelines

CI/CD

DevOps

Linux/UNIX

Data security

Education

Bachelor’s degree in Computer Science, Engineering, or related technical discipline

Tools

Python

Java

SQL

Shell scripting

Elastic Stack

Kafka

AWS

OpenShift

Kubernetes

Git

Bitbucket

JIRA

Confluence

Job description

Tetrad Digital Integrity (TDI) is seeking a Data Engineering Software Developer to support a new Agile team in federal IT modernization. This onsite role in the Washington, DC area offers a ground-floor opportunity to architect, build, and integrate cutting-edge data infrastructure for DoD missions.

The candidate will design and operate scalable data pipelines, leverage Kafka, Elastic, AWS, and OpenShift, and collaborate with analysts to deliver secure, compliant analytics and dashboards.