Senior Data Engineer - Secure Cloud Data Pipelines (Remote)

defenseunicorns; United States; Remote; USD 149,000 - 201,000; Full time

Benefits offered by this job

Fully paid medical, dental, and vision

HSA access

Retirement matching

Stock options

Home-office budget

Flexible paid time off

Training and conferences

Job summary

defenseunicorns is seeking a data engineer to design, operate, and secure production data platforms across AWS cloud and on‑premises environments. You will handle data pipelines, streaming systems, Kubernetes operations, and infrastructure automation to support government and defense standards.

The role requires 5+ years building data pipelines and deploying Kafka/Redpanda in Kubernetes, with strong security practices and collaboration with platform and cybersecurity teams. Remote US‑based role.

Qualifications

• At least 5 years building and operating production data pipelines, databases, and data-exchange services on Kubernetes.
• Experience deploying Kafka or Redpanda streaming platforms in Kubernetes environments.
• Ability to create high-volume data pipelines from the ground up and manage related data stores.
• Experience with Docker, Kubernetes, systems engineering, API security, container security, and cloud security.

Responsibilities

• Build data workflows and ETL/ELT pathways with strong data quality controls and secure information exchange.
• Apply systems-engineering practices to improve reliability, scalability, maintainability, backup, and recovery of data-layer services.
• Architect, deploy, and operate Kafka, Redpanda, Kinesis, or comparable streaming tech on Kubernetes using declarative configuration.
• Partner with platform engineers on configuration management, security, performance, and infrastructure provisioning in Kubernetes and AWS.
• Use infrastructure-as-code practices (Terraform) and cybersecurity guidance to protect data systems.
• Ensure data platforms comply with DoD and other government regulations and standards.
• Track developments in Kubernetes, containers, streaming, and data engineering to apply improvements.

Skills

Data pipelines

Kafka/Redpanda

Kubernetes

Docker

Terraform

Cloud security

API security

Problem solving

Stakeholder collaboration

Tools

Kafka/Redpanda

Docker

Kubernetes

Terraform

AWS

Job description

defenseunicorns is seeking a data engineer to design, operate, and secure production data platforms across AWS cloud and on‑premises environments. You will handle data pipelines, streaming systems, Kubernetes operations, and infrastructure automation to support government and defense standards.

The role requires 5+ years building data pipelines and deploying Kafka/Redpanda in Kubernetes, with strong security practices and collaboration with platform and cybersecurity teams. Remote US‑based role.