Data Platform Engineer - Kafka, Elastic, AWS (TS/SCI)

Leidos; United States; Remote; USD 108,000 - 195,000; Full time

Job summary

Leidos is building a new Agile development team in the Digital Sector to modernize federal IT infrastructure. The role focuses on designing, building, and maintaining scalable data systems and pipelines for analytics, with a TS/SCI clearance and DoD compliance.

You will work on Confluent Kafka, Elastic Stack, AWS, and OpenShift, delivering secure, high-performance data platforms for critical missions in a highly collaborative Agile environment.

Qualifications

• Bachelor's degree in Computer Science, Engineering, or related field.
• Active TS/SCI clearance required for consideration.
• Hands-on design, build, and maintenance of data pipelines (ETL/ELT).
• Experience with data warehouses/lakes (Redshift/S3/Hadoop/Snowflake).
• Proficient in Python, Java, SQL, and shell scripting; strong data engineering skills.
• Familiarity with Elastic/Kafka for ingestion and processing; Kubernetes and CI/CD.

Responsibilities

• Designs, builds, and maintains scalable data systems and pipelines for analytics and reporting.
• Unifies data from multiple network operations sources into a secure, compliant platform.
• Implements pipelines with Confluent Kafka, Elastic Stack, AWS, and OpenShift; supports dashboards.
• Develops data warehouses/lakes and optimizes performance, scalability, and cost.
• Optimizes ingestion throughput, queries, indexing, and storage across Elastic and Kafka.
• Automates ETL/ELT tasks and supports CI/CD for automation in build/test/deploy.
• Collaborates with analysts and visualization engineers; documents architecture and procedures.
• Troubleshoots data ingestion, processing, and platform performance issues.

Skills

TS/SCI clearance

ETL/ELT pipelines

Python

Java

SQL

Shell scripting

Data pipelines design

CI/CD pipelines

Git

Confluent Kafka

Elastic Stack

Kubernetes

DoD/DISA RMF STIGs

React/JS/HTML

Data quality and security

Education

Bachelor's degree in Computer Science or Engineering

Tools

AWS Redshift

S3

Hadoop

Snowflake

Git

Bitbucket

JIRA

Confluence

Kubernetes

Elastic

Kafka

OpenShift

Job description

Leidos is building a new Agile development team in the Digital Sector to modernize federal IT infrastructure. The role focuses on designing, building, and maintaining scalable data systems and pipelines for analytics, with a TS/SCI clearance and DoD compliance.

You will work on Confluent Kafka, Elastic Stack, AWS, and OpenShift, delivering secure, high-performance data platforms for critical missions in a highly collaborative Agile environment.