Senior Data Pipeline Engineer – TS/SCI, Onsite DC

The Amatriot Group; Washington (District of Columbia); On-site; USD 235,000 - 265,000; Full time

Job summary

The Amatriot Group seeks a Data Engineering Software Developer SME to design, build, and maintain scalable data systems within DoD and DISA environments. You will lead data ingestion, transformation, and platform optimization using Kafka, Elastic, AWS, and OpenShift/Kubernetes, collaborating across software, data, and network operations teams.

This role requires TS/SCI clearance and 100% onsite work in Washington, DC, with expertise in ETL/ELT, data warehouses/lakes, and CI/CD practices to

Qualifications

• Hands-on experience designing, building, and maintaining ETL/ELT data pipelines.
• Experience with data warehouse and/or data lake technologies such as AWS Redshift, Amazon S3, Hadoop, Snowflake, or similar platforms.
• Experience with Elastic Stack, including Elasticsearch, Logstash, and Kibana, and/or Kafka for data ingestion and processing.
• Experience with Linux/UNIX system administration and automation.
• Experience with CI/CD pipelines, containerized pipelines, version control technologies such as Git and Bitbucket, and DevOps practices.
• Familiarity with network operations data, including logs, metrics, events, ticketing, CMDB data, and related data models.

Responsibilities

• Design, build, and maintain scalable and reliable data systems and pipelines to ingest, process, and transform large, complex, and disparate data sources for analytics and reporting.
• Unify and integrate data from multiple network operations systems into a consistent and accessible platform.
• Create and maintain Kafka, Elastic, and Logstash pipelines supporting enterprise data ingestion and processing.
• Automate ETL/ELT processes, data validation, cleansing, monitoring, and related data-processing activities.
• Implement data solutions using Confluent Kafka, Elastic Stack, AWS, and OpenShift/Kubernetes.
• Develop and manage data warehouses and data lakes supporting analytics, reporting, and operational dashboards.
• Support Kibana visualizations and dashboards using React, JavaScript, and HTML.
• Apply automation and engineering best practices to improve platform scalability, maintainability, and reliability.

Skills

Python

Java

SQL

Shell scripting

Data security

RMF/STIG compliance

Education

Bachelor’s degree in Computer Science, Engineering, or a related technical discipline

Master’s degree in Computer Science, Engineering, or a related technical discipline

Tools

Confluent Kafka

Elastic Stack

AWS

OpenShift/Kubernetes

Kibana

React

JavaScript

HTML

Job description

The Amatriot Group seeks a Data Engineering Software Developer SME to design, build, and maintain scalable data systems within DoD and DISA environments. You will lead data ingestion, transformation, and platform optimization using Kafka, Elastic, AWS, and OpenShift/Kubernetes, collaborating across software, data, and network operations teams.

This role requires TS/SCI clearance and 100% onsite work in Washington, DC, with expertise in ETL/ELT, data warehouses/lakes, and CI/CD practices to