Data Engineer - Secure Cloud Pipelines (Kubernetes)

United States Digital Space LLC; United States; Remote; USD 149,000 - 201,000; Full time

Benefits offered by this job

Medical/Dental/Vision

Company-paid premiums

Health Savings Account

Life Insurance

Disability Insurance

401k Retirement Plan

Company Stock Options

Home Office Budget

Flexible Time Off

Job summary

United States Digital Space LLC is seeking a data engineering lead to design and operate resilient data pipelines across Kubernetes and AWS. You will implement streaming solutions (Kafka/Redpanda) and ensure secure, compliant data exchange for government-driven workloads.

The role requires 5+ years building production data systems, strong Kubernetes and Terraform skills, and DoD security awareness. Remote work in the USA with periodic travel is expected.

Qualifications

• Minimum 5 years building and maintaining production data pipelines, databases, and data exchange services on Kubernetes.
• Experience designing, deploying, and operating Kafka/Redpanda data streaming solutions on Kubernetes.
• Experience creating data pipelines from scratch to process large data volumes and manage data stores.
• Familiar with Docker and container orchestration (Kubernetes).
• Knowledge of systems engineering principles for reliability, scalability, and maintainability.

Responsibilities

• Design data workflows, pipelines, and pathways to support ETL/ELT and secure data exchange across AWS and on-prem environments.
• Implement systems engineering principles to ensure reliability, scalability, and maintainability of data layer systems including backup/recovery strategies.
• Architect, deploy, and operate data streaming technologies (Kafka, Redpanda, Kinesis) on Kubernetes with declarative definitions.
• Collaborate with platform team to apply best practices for configuration management, security, and performance in Kubernetes and AWS.
• Automate infrastructure provisioning, monitoring, and scaling using Terraform, working with cybersecurity SMEs to defend data layers.
• Ensure data layer systems comply with DoD standards and industry regulations.
• Stay current with Kubernetes, containerization, and data engineering trends.

Skills

Data pipelines

ETL/ELT

Kubernetes

AWS

Kafka/Redpanda

Kinesis

Terraform

Security best practices

DoD compliance

ML concepts

Tools

Kafka

Redpanda

Kinesis

Docker

Kubernetes

Terraform

Pulumi

Job description

United States Digital Space LLC is seeking a data engineering lead to design and operate resilient data pipelines across Kubernetes and AWS. You will implement streaming solutions (Kafka/Redpanda) and ensure secure, compliant data exchange for government-driven workloads.

The role requires 5+ years building production data systems, strong Kubernetes and Terraform skills, and DoD security awareness. Remote work in the USA with periodic travel is expected.