Remote Data Engineer — Cloud-Native Pipelines & Security

DaParrot Ltd; United States; Remote; USD 149,000 - 201,000; Full time

Benefits offered by this job

Health insurance

401k Retirement Plan

Company stock options

Home office budget

Paid parental leave

Training reimbursements

Job summary

Defense Unicorns is seeking a data engineering-focused platform engineer to design and operate data workflows across AWS and on-prem environments. You will build and maintain streaming data pipelines using Kubernetes, Kafka/Redpanda, and Kinesis, while ensuring security and compliance in a DoD-aligned setup.

The role requires 5+ years in data pipelines on Kubernetes, containerization with Docker, and strong collaboration with platform teams.

Qualifications

• 5+ years building production data pipelines on Kubernetes.
• Experience designing, deploying, operating Kafka/Redpanda data streaming on Kubernetes.
• Familiarity with Docker and container orchestration (Kubernetes).
• Knowledge of API security, container security, AWS security practices.

Responsibilities

• Design data workflows and pipelines across AWS and on-prem environments.
• Ensure reliability, scalability, and maintainability of data layer systems.
• Architect and operate data streaming tech (Kafka/Redpanda, Kinesis) on Kubernetes.
• Collaborate to implement configuration management, security, and performance optimization.
• Automate infrastructure provisioning and monitoring with Terraform while aligning with DoD standards.
• Ensure compliance with DoD regulations and industry best practices.
• Stay current with Kubernetes, containerization, and data engineering trends.

Skills

Data pipelines

Kubernetes

Kafka/Redpanda

AWS

Terraform

Security

USA Security clearance

Tools

Docker

Terraform

Kafka/Redpanda

Job description

Defense Unicorns is seeking a data engineering-focused platform engineer to design and operate data workflows across AWS and on-prem environments. You will build and maintain streaming data pipelines using Kubernetes, Kafka/Redpanda, and Kinesis, while ensuring security and compliance in a DoD-aligned setup.

The role requires 5+ years in data pipelines on Kubernetes, containerization with Docker, and strong collaboration with platform teams.