Data Engineering Software Developer

tetraddigitalintegrityllc; Washington (District of Columbia); On-site; USD 130,000 - 145,000; Full time

Job summary

Tetrad Digital Integrity (TDI) is seeking a Data Engineering Software Developer to join a new Agile team supporting federal IT modernization from the Washington, DC area. The role requires an active TS/SCI clearance and on-site work, with responsibilities spanning data pipelines, data warehouses, and analytics platforms.

You will implement solutions using Kafka, Elastic Stack, AWS, and OpenShift, while collaborating with analysts and visualization engineers to deliver integrated data solutions

Qualifications

• Active DoD TS/SCI security clearance and ability to pass screening prior to start.
• Bachelor’s degree in Computer Science, Engineering, or related technical discipline.
• 8+ years of relevant experience designing data pipelines (ETL/ELT) and integrating multiple data sources.
• Experience with data warehouse and/or data lake technologies (e.g., AWS Redshift, S3, Hadoop, Snowflake, or similar).
• Proficiency with Python, Java, SQL, and shell scripting.
• Experience with Elastic Stack (Elasticsearch, Logstash, Kibana) and/or Kafka for data ingestion and processing.
• Familiarity with DoD data models and security standards (DoD, DISA).
• Experience with CI/CD pipelines, containerized pipelines, Git/Bitbucket, and DevOps practices.

Responsibilities

• Designs, builds, and maintains scalable data systems and pipelines for analytics and reporting.
• Unifies and integrates data from multiple network operations systems into a consistent platform with data quality, security, and compliance.
• Implements solutions using Confluent Kafka, Elastic Stack, AWS, and Red Hat OpenShift (Kubernetes), including creating pipelines and dashboards with Kibana/React.
• Develops and manages data warehouses and data lakes to support analytics and dashboards, optimizing for performance, scalability, and cost.
• Continually optimize ingestion throughput, query performance, and storage across Elastic and Kafka.
• Automates ETL/ELT, data validation, cleansing, monitoring, and supports CI/CD pipelines for automated build, test, and deployment.
• Collaborates with data analysts and visualization engineers to deliver integrated, actionable data solutions and documents architecture and procedures.
• Troubleshoots and resolves issues related to data ingestion, processing, and platform performance.

Skills

Data pipeline design

Python/Java/SQL

CI/CD/DevOps

Elastic Stack/Kafka

Linux/UNIX

Security clearance

Education

Bachelor's degree in Computer Science, Engineering, or related technical discipline

Tools

AWS

OpenShift / Kubernetes

Elastic Stack

Kafka

Job description

Tetrad Digital Integrity (TDI) is a leading-edge cybersecurity firm with a mission to safeguard and protect our customers from increasing threats and vulnerabilities in this digital age.

TDI is seeking a Data Engineering Software Developer to support a brand-new Agile development team at the forefront of federal IT modernization, delivering real digital transformation where it matters most. This is a rare ground-floor opportunity to architect, build, and integrate cutting-edge infrastructure solutions in support of some of our nation's most sensitive and critical missions.

This is a fully onsite opportunity requiring a daily commute to the Washington, DC area. An active TS/SCI security clearance is required.

RESPONSIBILITIES:

• Designs, builds, and maintainsscalable, reliable data systems and pipelines to ingest, process, and transform large, complex, and disparate data sources for analytics and reporting.
• Unifies and integrates data from multiple network operations systems into a consistent, accessible platform, ensuring data quality, accuracy, security, and compliance with DoD and DISA requirements.
• Implements solutions using Confluent Kafka, Elastic Stack, AWS, and Red Hat OpenShift (Kubernetes), including creating Kafka, Elastic, and Logstash pipelines and supporting Kibana visualizations and dashboards with React, JavaScript, and HTML.
• Develops and manages data warehouses and data lakes to support analytics, reporting, and operational dashboards, optimizing infrastructure for performance, scalability, and cost-effectiveness through automation and best practices.
• Continually analyze and optimize ingestion throughput, query performance, indexing strategies, and storage efficiency across Elastic and Kafka platforms.
• Automates data-related tasks such as ETL/ELT processes, data validation, cleansing, monitoring, and supports CI/CD pipelines for automated build, test, and deployment.
• Collaborates with data analysts, visualization engineers, and other stakeholders to deliver integrated, actionable data solutions, and documents data architecture, integration patterns, and operational procedures.
• Troubleshoots and resolves issues related to data ingestion, processing, and platform performance, storage, memory, partitioning, and cluster performance.

QUALIFICATIONS:

• Active DoD TS/SCI security clearance.Ability to pass additional customer suitability screening(s) prior to start.
• Current Security+ or equivalent/higher
• Bachelor’s degree in Computer Science, Engineering, or related technical discipline and 8+ years of relevant experience.
• Hands‑on experience designing, building, and maintaining data pipelines (ETL/ELT) and integrating multiple, disparate data sources.
• Experience with data warehouse and/or data lake technologies (e.g., AWS Redshift, S3, Hadoop, Snowflake, or similar).
• Proficiency with data engineering tools and languages such as Python, Java, SQL, and shell scripting.
• Experience with Elastic Stack (Elasticsearch, Logstash, Kibana) and/or Kafka for data ingestion and processing.
• Familiarity with network operations data (logs, metrics, events, ticketing, CMDB) and related data models.
• Experience with Linux/UNIX system administration and automation.
• Knowledge of data security, access controls, and compliance frameworks (DoD, DISA, RMF, STIGs).
• Experience with CI/CD pipelines, containerized pipelines, version control (Git, Bitbucket), and DevOps practices.

PREFERRED QUALIFICATIONS:

• Experience with DISA, DISN, or other DoD network environments, including developing and deploying software applications that meet DoD security standards (e.g., STIGs), and knowledge of network security, encryption, and access controls in classified environments.
• Familiarity with Kubernetes deployment, platform upgrades, patching, configuration management tools (Ansible, Puppet, Chef), and monitoring, alerting, and observability tools (Prometheus, Grafana, Elastic)
• Strong understanding and practical experience with Agile methodologies (Scrum, SAFe), and related tools such as Atlassian JIRA and Confluence.

PAY RANGE:

The anticipated salary range for this position is $130,000 - $145,000. This range is a good‑faith estimate and not a guarantee of compensation. Final compensation will be based on factors including experience, education, skills, geographic location, internal equity, market data and applicable contract requirements, and may fall outside the posted range.

TDI does business with the federal government, which restricts employment to individuals who are either US citizens or lawful permanent residents of the United States.

“TDI is an Equal Opportunity Employer. Employment decisions are made based on individual qualifications, merit, and business needs. We do not discriminate in employment opportunities or practices based on race, color, religion, sex, or national origin, in accordance with applicable federal laws.”