Real-Time Data Engineer: Backend (Kafka/ELK)

Leidos; Scott Air Force Base (IL); On-site; USD 87,000 - 157,000; Full time

Benefits offered by this job

On-site work at Scott AFB

Job summary

Leidos is seeking a Data Engineer Software Developer to join the RTV team under GSM-O II to design, build, and sustain data pipelines and platforms for the DISN/DoD mission. The role focuses on ingesting, storing, and processing logs, metrics, events, and CMDB data using Elastic Stack and Confluent Kafka, with a strong emphasis on CI/CD and data governance.

The candidate will work onsite near Scott AFB, IL, and must obtain a Secret clearance and Security+ within the required timeframe.

Qualifications

• Bachelor’s degree and 4+ years of relevant experience.
• Hands-on experience designing and maintaining data pipelines (ETL/ELT).
• Experience with data warehouse and data lake technologies (Redshift/S3/Hadoop/Snowflake).
• Proficiency with Python, Java, SQL, and shell scripting.
• Experience with Elastic Stack and/or Kafka for ingestion/processing.
• Familiarity with network operations data and data models.
• Experience with Linux/UNIX administration and automation.
• Knowledge of DoD/DISA RMF/STIGs and data security basics.
• CI/CD, containers, Git, and DevOps practices.
• Strong communication and documentation skills.

Responsibilities

• Designs, builds, and maintains scalable data systems and pipelines for analytics.
• Unifies data from multiple network operations sources into a consistent platform.
• Implements solutions using Confluent Kafka, Elastic Stack, AWS, and OpenShift.
• Develops data warehouses and data lakes to support analytics and dashboards.
• Optimizes ingestion throughput, query performance, and storage across Elastic and Kafka.
• Automates ETL/ELT processes and supports CI/CD pipelines.
• Collaborates with analysts and visualization engineers to deliver integrated data solutions.
• Troubleshoots data ingestion, processing, and platform performance issues.

Skills

Python

Java

SQL

Linux/UNIX

ETL/ELT

CI/CD

Data security

Communication

Education

Bachelor's degree in Computer Science or related field

Tools

Elastic Stack

Kafka

OpenShift/Kubernetes

AWS

Redshift/Snowflake

Git

Job description

Leidos is seeking a Data Engineer Software Developer to join the RTV team under GSM-O II to design, build, and sustain data pipelines and platforms for the DISN/DoD mission. The role focuses on ingesting, storing, and processing logs, metrics, events, and CMDB data using Elastic Stack and Confluent Kafka, with a strong emphasis on CI/CD and data governance.

The candidate will work onsite near Scott AFB, IL, and must obtain a Secret clearance and Security+ within the required timeframe.