Data Platform Engineer: Kubernetes, Kafka on AWS (Remote)

defenseunicorns; United States; Remote; USD 149,000 - 201,000; Full time

Benefits offered by this job

Health, dental, vision premiums fully

HSA benefits

Stock options

Home-office budget

Flexible PTO

Federal holidays

Paid parental leave

Training and conference support

Job summary

defenseunicorns seeks a seasoned Data Engineer to design, operate, and secure data platforms exchanging sensitive information across AWS and on-premises environments. You will own production data pipelines, streaming systems, Kubernetes operations, and infrastructure automation, while aligning with government standards.

Collaboration with platform and cybersecurity teams is essential. Role emphasizes reliability engineering, compliance, and advancing data architecture; a background in DoD-grade

Qualifications

• 5+ years building and operating production data pipelines, databases, and data-exchange services on Kubernetes.
• Experience designing, deploying, and supporting Kafka/Redpanda streaming platforms in Kubernetes environments.
• Ability to create high-volume data pipelines from the ground up and manage the associated data stores.
• Experience with Docker, Kubernetes, systems engineering, API security, container security, and cloud security.
• Strong problem-solving skills, self-direction, and ability to work with technical and non-technical stakeholders.
• U.S. citizenship and ability to obtain a Secret-level DoD clearance.

Responsibilities

• Build data workflows and ETL/ELT pathways with strong data quality controls.
• Improve reliability, scalability, maintainability, backup, and recovery of data-layer services.
• Architect, deploy, and operate Kafka, Redpanda, Kinesis, or comparable streaming tech on Kubernetes using declarative config.
• Partner with platform engineers on configuration management, security, and performance tuning in Kubernetes and AWS.
• Use infrastructure-as-code, including Terraform, and apply cybersecurity guidance to protect data systems.
• Ensure data platforms comply with DoD and government regulations and standards.
• Stay updated on Kubernetes, containers, streaming, and data engineering trends and apply improvements.

Skills

Kubernetes

Data pipelines

Kafka/Redpanda

Docker

Cloud security

Problem solving

Stakeholder communication

Tools

Terraform

Job description

defenseunicorns seeks a seasoned Data Engineer to design, operate, and secure data platforms exchanging sensitive information across AWS and on-premises environments. You will own production data pipelines, streaming systems, Kubernetes operations, and infrastructure automation, while aligning with government standards.

Collaboration with platform and cybersecurity teams is essential. Role emphasizes reliability engineering, compliance, and advancing data architecture; a background in DoD-grade