Senior Data Engineer — ETL & Streaming Pipelines (TS/SCI)

SOSi; Chantilly (NC); On-site; USD 130,000 - 190,000; Full time

Job summary

SOSi is seeking a highly skilled Senior Data Engineer to support a US government customer in Chantilly, VA. The role involves delivering batch and streaming data pipelines, collaborating with data scientists and cyber analysts, and ensuring scalable data management solutions.

You will design, build, and analyze data pipelines, contribute to CI/CD for data services, and work in a team-oriented environment with security at the forefront.

Qualifications

• Active TS/SCI clearance with poly, U.S. citizenship required.
• 5–7 years of experience as a Data Engineer.
• Experience with Apache Kafka, Apache Spark, and Prefect.
• Experience containerizing applications using Docker and deployments on Kubernetes.
• Familiarity with Linux-based systems.
• Solid understanding of DevOps principles (automation, monitoring, reliability).

Responsibilities

• Develop and perform ETL on large unstructured datasets.
• Building and maintaining CI/CD pipelines for data and platform services.

Skills

Data engineering

Kafka

Spark

Prefect

Docker

Kubernetes

Linux

DevOps

TS/SCI clearance

Education

STEM degree (CS/Math/Stats/CE)

Tools

Docker

Kubernetes

Apache Kafka

Apache Spark

Prefect

Job description

SOSi is seeking a highly skilled Senior Data Engineer to support a US government customer in Chantilly, VA. The role involves delivering batch and streaming data pipelines, collaborating with data scientists and cyber analysts, and ensuring scalable data management solutions.

You will design, build, and analyze data pipelines, contribute to CI/CD for data services, and work in a team-oriented environment with security at the forefront.