Data Engineer - Kubernetes & Cloud Data Pipelines

The Briefed; Northern (KY); Hybrid; USD 149,000 - 201,000; Full time

Benefits offered by this job

Medical/Dental/Vision coverage

401k with company match

Company stock options

Home office budget

Paid holidays

Job summary

Defense Unicorns seeks a seasoned data engineering specialist to design and operate robust data pipelines in Kubernetes, across AWS and on-prem environments. The role emphasizes reliability, security, and scalable streaming solutions, with DoD compliance requirements.

The candidate will work with a platform team to implement best practices in configuration, security, and performance, while leveraging Terraform for infra automation and pursuing cutting-edge data engineering trends.

Qualifications

• 5+ years building production data pipelines, databases, and data exchange services on Kubernetes.
• Experience with Kafka/Redpanda data streaming on Kubernetes.
• Familiarity with containerization (Docker) and orchestration (Kubernetes).

Responsibilities

• Designing data workflows, pipelines, and pathways to support ETL/ELT across AWS and on-prem; ensure data-quality and secure data exchange.
• Implementing systems engineering for reliability, scalability, and maintainability of data layer systems; include backup/recovery strategies.
• Architecting, deploying, and operating data streaming tech (Kafka, Redpanda, Kinesis) on Kubernetes with declarative definitions.
• Collaborating with platform team to implement security, performance, and configuration management in Kubernetes/AWS.
• Automating infrastructure provisioning, monitoring, and scaling using Terraform, while aligning with cybersecurity best practices.
• Ensuring data layer systems comply with DoD/regulatory standards and industry best-practices.
• Staying current with Kubernetes, containerization, and data engineering trends.

Skills

Kubernetes

AWS Cloud

Data pipelines

Security

CI/CD

Tools

Terraform

Job description

Defense Unicorns seeks a seasoned data engineering specialist to design and operate robust data pipelines in Kubernetes, across AWS and on-prem environments. The role emphasizes reliability, security, and scalable streaming solutions, with DoD compliance requirements.

The candidate will work with a platform team to implement best practices in configuration, security, and performance, while leveraging Terraform for infra automation and pursuing cutting-edge data engineering trends.