Senior Data Engineer - Scalable Pipelines & DoD Compliance

Amatriot Group, LLC; United States; On-site; USD 175,000 - 200,000; Full time

Job summary

Amatriot Group, LLC seeks a Senior Data Engineer in Washington, DC to design, build, and sustain scalable data systems and pipelines across complex enterprise environments. The role focuses on ingesting, processing, transforming, and unifying data sources while ensuring data quality, security, and compliance with DoD and DISA requirements.

The candidate will work with Confluent Kafka, Elastic Stack, AWS, OpenShift/Kubernetes, data warehouses, and data lakes; supporting automation, CI/CD,

Qualifications

• Hands on experience designing, building and maintaining ETL/ELT data pipelines.
• Experience with data warehouse and data lake technologies (AWS Redshift, S3, Hadoop, Snowflake).
• Experience with Elastic Stack (Elasticsearch, Logstash, Kibana) and Kafka.
• Linux/UNIX system administration and automation skills.
• CI/CD pipelines and DevOps practices; version control (Git/Bitbucket).
• Familiarity with DoD DISA RMF and STIG requirements.
• Strong written and verbal communication; documentation skills.
• Active Security clearance (TSSCI) or higher.

Responsibilities

• Data Pipeline Engineering: design, build, and maintain scalable pipelines.
• Unify data from multiple systems into a consistent platform.
• Create and maintain Kafka, Elastic, and Logstash pipelines.
• Automate ETL/ELT processes and data quality checks.
• Develop data warehouses and lakes for analytics and dashboards.
• Optimize infrastructure for scalability, performance, and cost.
• Support CI/CD, platform automation, and operational efficiency.
• Collaborate across data, software, and network operations teams.

Skills

ETL/ELT pipelines

Data ingestion

Data integration

Python/Java/SQL

CI/CD pipelines

Linux/UNIX

Shell scripting

Security awareness

Communication

Education

Bachelors degree in CS/Engineering

Tools

Kafka

Elastic Stack

AWS

OpenShift/Kubernetes

ELK Stack

Job description

Amatriot Group, LLC seeks a Senior Data Engineer in Washington, DC to design, build, and sustain scalable data systems and pipelines across complex enterprise environments. The role focuses on ingesting, processing, transforming, and unifying data sources while ensuring data quality, security, and compliance with DoD and DISA requirements.

The candidate will work with Confluent Kafka, Elastic Stack, AWS, OpenShift/Kubernetes, data warehouses, and data lakes; supporting automation, CI/CD,