Data Engineering Architect (TS/SCI, Onsite DC)

tetraddigitalintegrityllc; Washington (District of Columbia); On-site; USD 130,000 - 145,000; Full time

Job summary

Tetrad Digital Integrity (TDI) is seeking a Data Engineering Software Developer to join a new Agile team supporting federal IT modernization from the Washington, DC area. The role requires an active TS/SCI clearance and on-site work, with responsibilities spanning data pipelines, data warehouses, and analytics platforms.

You will implement solutions using Kafka, Elastic Stack, AWS, and OpenShift, while collaborating with analysts and visualization engineers to deliver integrated data solutions

Qualifications

• Active DoD TS/SCI security clearance and ability to pass screening prior to start.
• Bachelor’s degree in Computer Science, Engineering, or related technical discipline.
• 8+ years of relevant experience designing data pipelines (ETL/ELT) and integrating multiple data sources.
• Experience with data warehouse and/or data lake technologies (e.g., AWS Redshift, S3, Hadoop, Snowflake, or similar).
• Proficiency with Python, Java, SQL, and shell scripting.
• Experience with Elastic Stack (Elasticsearch, Logstash, Kibana) and/or Kafka for data ingestion and processing.
• Familiarity with DoD data models and security standards (DoD, DISA).
• Experience with CI/CD pipelines, containerized pipelines, Git/Bitbucket, and DevOps practices.

Responsibilities

• Designs, builds, and maintains scalable data systems and pipelines for analytics and reporting.
• Unifies and integrates data from multiple network operations systems into a consistent platform with data quality, security, and compliance.
• Implements solutions using Confluent Kafka, Elastic Stack, AWS, and Red Hat OpenShift (Kubernetes), including creating pipelines and dashboards with Kibana/React.
• Develops and manages data warehouses and data lakes to support analytics and dashboards, optimizing for performance, scalability, and cost.
• Continually optimize ingestion throughput, query performance, and storage across Elastic and Kafka.
• Automates ETL/ELT, data validation, cleansing, monitoring, and supports CI/CD pipelines for automated build, test, and deployment.
• Collaborates with data analysts and visualization engineers to deliver integrated, actionable data solutions and documents architecture and procedures.
• Troubleshoots and resolves issues related to data ingestion, processing, and platform performance.

Skills

Data pipeline design

Python/Java/SQL

CI/CD/DevOps

Elastic Stack/Kafka

Linux/UNIX

Security clearance

Education

Bachelor's degree in Computer Science, Engineering, or related technical discipline

Tools

AWS

OpenShift / Kubernetes

Elastic Stack

Kafka

Job description

Tetrad Digital Integrity (TDI) is seeking a Data Engineering Software Developer to join a new Agile team supporting federal IT modernization from the Washington, DC area. The role requires an active TS/SCI clearance and on-site work, with responsibilities spanning data pipelines, data warehouses, and analytics platforms.

You will implement solutions using Kafka, Elastic Stack, AWS, and OpenShift, while collaborating with analysts and visualization engineers to deliver integrated data solutions