Data Engineering for Federal IT Modernization (Onsite)

Tetrad-Digital-Integrity-LL; Washington (District of Columbia); On-site; USD 130,000 - 145,000; Full time

Job summary

Tetrad Digital Integrity (TDI) is seeking a Data Engineering Software Developer to join a new Agile team for federal IT modernization. This on-site role in the Washington, DC area requires an active TS/SCI clearance and hands-on data pipeline experience.

You will design and optimize data systems, integrate multiple data sources, and develop dashboards with Elastic/Kafka, AWS, and OpenShift, driving scalable analytics and secure DoD-compliant solutions.

Qualifications

• Active DoD TS/SCI security clearance. Ability to pass additional suitability screenings.
• Current Security+ or equivalent/higher
• Bachelor’s degree in Computer Science, Engineering, or related technical discipline and 8+ years of relevant experience.
• Hands‑on experience designing, building, and maintaining data pipelines (ETL/ELT).
• Experience with data warehouse and/or data lake technologies (AWS Redshift, S3, Hadoop, Snowflake, or similar).
• Proficiency with Python, Java, SQL, and shell scripting.
• Experience with Elastic Stack and/or Kafka for data ingestion and processing.
• Familiarity with network operations data and related data models.
• Experience with Linux/UNIX system administration and automation.
• Knowledge of data security, access controls, and compliance frameworks (DoD, DISA, RMF, STIGs).
• Experience with CI/CD pipelines, containerized pipelines, version control (Git, Bitbucket), and DevOps practices.

Responsibilities

• Designs, builds, and maintains scalable, reliable data systems and pipelines to ingest, process, and transform large, complex data sources for analytics and reporting.
• Unifies and integrates data from multiple network operations systems into a consistent, accessible platform, ensuring data quality, accuracy, security, and compliance with DoD and DISA requirements.
• Implements solutions using Confluent Kafka, Elastic Stack, AWS, and Red Hat OpenShift (Kubernetes), including creating Kafka, Elastic, and Logstash pipelines and supporting Kibana visualizations and dashboards with React, JavaScript, and HTML.
• Develops and manages data warehouses and data lakes to support analytics, reporting, and operational dashboards, optimizing infrastructure for performance, scalability, and cost-effectiveness through automation and best practices.
• Continually analyze and optimize ingestion throughput, query performance, indexing strategies, and storage efficiency across Elastic and Kafka platforms.
• Automates data-related tasks such as ETL/ELT processes, data validation, cleansing, monitoring, and supports CI/CD pipelines for automated build, test, and deployment.
• Collaborates with data analysts, visualization engineers, and other stakeholders to deliver integrated, actionable data solutions, and documents data architecture, integration patterns, and operational procedures.
• Troubleshoots and resolves issues related to data ingestion, processing, and platform performance, storage, memory, partitioning, and cluster performance.

Skills

Python

Java

SQL

Shell scripting

CI/CD pipelines

Elastic Stack

Kafka

Linux/UNIX

Git

Bitbucket

Kubernetes

Ansible

Puppet

Chef

Prometheus

Grafana

Security+

Education

Bachelor’s degree in Computer Science, Engineering, or related technical discipline

Tools

Elastic Stack

Kafka

AWS

Red Hat OpenShift (Kubernetes)

React/JavaScript/HTML

Linux/UNIX

Git

Bitbucket

Jira

Confluence

Job description

Tetrad Digital Integrity (TDI) is seeking a Data Engineering Software Developer to join a new Agile team for federal IT modernization. This on-site role in the Washington, DC area requires an active TS/SCI clearance and hands-on data pipeline experience.

You will design and optimize data systems, integrate multiple data sources, and develop dashboards with Elastic/Kafka, AWS, and OpenShift, driving scalable analytics and secure DoD-compliant solutions.