Senior Data Engineering Specialist: Kafka, AWS, ELK | DoD

Amatriot Group, LLC; United States; On-site; USD 235,000 - 265,000; Full time

Job summary

Amatriot Group, LLC is seeking a Data Engineering Software Developer SME to design, build, and maintain scalable data pipelines and platforms in DoD/DISA environments. You will work with Confluent Kafka, Elastic Stack, AWS, and OpenShift Kubernetes to ingest, process, and secure large data sets for analytics and operational dashboards.

The role requires hands-on experience with ETL/ELT, data warehouses and lakes, Linux administration, and DevOps practices.

Qualifications

• Hands on experience designing building and maintaining ETL/ELT data pipelines and integrating multiple disparate data sources.
• Experience with data warehouse and/or data lake technologies such as AWS Redshift, Amazon S3, Hadoop, Snowflake, or similar platforms.
• Experience with Elastic Stack including Elasticsearch, Logstash, and Kibana and/or Kafka for data ingestion and processing.
• Experience with Linux/UNIX system administration and automation.
• Experience with CICD pipelines, containerized pipelines, version control technologies such as Git and Bitbucket and DevOps practices.
• Familiarity with network operations data including logs, metrics, events, ticketing, CMDB data and related data models.

Responsibilities

• Design, build, and maintain scalable data systems and pipelines for analytics and reporting.
• Integrate data from multiple network operations systems into a unified platform.
• Develop Kafka, Elastic, and Logstash pipelines for data ingestion and processing.
• Automate ETL/ELT processes, data validation, cleansing, monitoring.
• Support Kibana visualizations and dashboards using React/JavaScript/HTML.
• Collaborate across software, data analytics, and network operations teams.
• Ensure data security and compliance with DoD/DISA requirements.

Skills

Python

Java

SQL

Shell scripting

Data pipelines

Education

Bachelor's degree in Computer Science

Master's degree in Computer Science

Tools

Confluent Kafka

Elastic Stack

AWS

OpenShift/Kubernetes

Elasticsearch

Logstash

Kibana

Snowflake

Hadoop

Databricks

Job description

Amatriot Group, LLC is seeking a Data Engineering Software Developer SME to design, build, and maintain scalable data pipelines and platforms in DoD/DISA environments. You will work with Confluent Kafka, Elastic Stack, AWS, and OpenShift Kubernetes to ingest, process, and secure large data sets for analytics and operational dashboards.

The role requires hands-on experience with ETL/ELT, data warehouses and lakes, Linux administration, and DevOps practices.