Senior Data Engineer - TS/SCI Clearance, Multi-Cloud

BuddoBot Inc.; Herndon (VA); Vor Ort; USD 130.000 - 170.000; Vollzeit

Zusammenfassung

Dark Wolf is seeking a Senior Data Engineer to design, build, and optimize robust data pipelines, data warehouses, and streaming solutions. You will integrate heterogeneous data sources, build advanced analytical models, automate workflows, and deploy containerized data services in multi-cloud secure environments.

You will work with PySpark, Airflow, Kafka, dbt, and modern data platforms to deliver scalable solutions, collaboration with Agile teams, and mentoring for junior engineers in

Qualifikationen

• Clearance: Must be a US Citizen holding an active TS/SCI security clearance with an active Full-Scope Polygraph.
• Education: Bachelor’s degree in Computer Science, Information Systems, Engineering, or a related technical field (Master’s degree preferred).
• Experience: 4-7+ years of data engineering experience.

Aufgaben

• Design and implement batch and real-time streaming data ingestion pipelines utilizing Spark, Kafka, and Airflow.
• Model and build performant data structures within enterprise data warehouses (e.g., Snowflake, Redshift, BigQuery).
• Deploy and manage containerized data microservices using Docker and Kubernetes.
• Integrate automated security scanning and credential management tools into CI/CD data pipelines.
• Collaborate within Agile teams to estimate user stories, review code, and mentor junior data engineers.

Kenntnisse

PySpark

Apache Airflow

Kafka

dbt

MPP databases

Distributed data stores

Graph databases

Key-value stores

Kimball modeling

Data Vault 2.0

Schema optimization

Python

SQL

Scala

Java

REST API

Docker

Kubernetes

Helm

Agile

AWS GovCloud

Azure

SAST/DAST

Data-at-rest encryption

Ausbildung

Bachelor's degree in Computer Science, Information Systems, Engineering, or a related technical field

Master's degree preferred

Tools

Snowflake

Redshift

BigQuery

Jobbeschreibung

Dark Wolf is seeking a Senior Data Engineer to design, build, and optimize robust data pipelines, data warehouses, and streaming solutions. You will integrate heterogeneous data sources, build advanced analytical models, automate workflows, and deploy containerized data services in multi-cloud secure environments.

You will work with PySpark, Airflow, Kafka, dbt, and modern data platforms to deliver scalable solutions, collaboration with Agile teams, and mentoring for junior engineers in