Data Engineer Software Developer

Via Logic LLC; Scott Air Force Base (IL); On-site; USD 87,100 - 157,450; Full time

Job summary

Leidos is seeking a Data Engineer Software Developer for the RTV team under GAINS to design and maintain scalable data systems. You will integrate data from logs, metrics, events, and CMDB sources into Confluent Kafka and Elastic stacks while supporting CI/CD practices.

The role focuses on building robust data pipelines, data warehouses, and dashboards for DoD mission data, with Onsite Scott AFB requirements and Secret clearance expectations.

Qualifications

• Bachelor’s degree in Computer Science, Engineering, or related technical discipline with 4+ years of relevant experience.
• Hands-on experience designing, building, and maintaining data pipelines (ETL/ELT).
• Experience with data warehouse and/or data lake technologies (e.g., AWS Redshift, S3, Hadoop, Snowflake).
• Proficiency with Python, Java, SQL, and shell scripting.
• Experience with Elastic Stack and/or Kafka for data ingestion and processing.
• Familiarity with network operations data (logs, metrics, events, ticketing, CMDB).
• Experience with Linux/UNIX system administration and automation.
• Knowledge of data security, access controls, and DoD/DISA RMF/STIGs.
• Experience with CI/CD pipelines, containerized deployments, Git/Bitbucket, and DevOps practices.
• Strong communication and documentation skills.

Responsibilities

• Designs, builds, and maintains scalable data systems and pipelines for analytics and reporting.
• Unifies data from multiple network operations sources into a consistent platform.
• Implements solutions using Confluent Kafka, Elastic Stack, AWS, and OpenShift.
• Develops data warehouses and data lakes to support analytics and dashboards.
• Optimizes ingestion throughput, query performance, and storage across Elastic and Kafka.
• Automates ETL/ELT, data validation, monitoring, and CI/CD pipelines.
• Collaborates with analysts and visualization engineers on data solutions.
• Troubleshoots data ingestion, processing, and platform performance issues.

Skills

Data pipelines

Data integration

Linux/UNIX

CI/CD

Documentation

Communication

Security compliance

Education

Bachelor’s degree in Computer Science or Engineering

Tools

Elastic Stack

Kafka

AWS

OpenShift / Kubernetes

SQL

Job description

The Leidos Digital Modernization Group seeks a Data Engineer Software Developer for the Global Solution Management - Operations II (GSM-O II) contract, under the Global Automations & Intelligent Network Solutions (GAINS) Team. Seeking a Back-End Developer to join the Real-Time Visibility (RTV) team, focused on designing, building, and maintaining the infrastructure and systems that collect, store, process, and analyze large volumes of network operations data for the DISN network. This role is critical for ensuring that data from disparate sources-such as logs, performance metrics, events, ticketing, ordering, and CMDB systems-is readily available, reliable, and performant for business and mission use. The existing platform is built on Elastic stack and Confluent Kafka platforms. The ideal candidate will have a strong background in data engineering, platform operations, and integration, with experience in large-scale, mission-critical environments.

As a key Real-Time Visibility team member, you will be conducting design and implementation for a variety of solution capabilities to integrating various data sources into Confluent (Kafka) and Elastic platforms, design of robust data integration solutions, and adhering to the program’s CI/CD processes and data governance practices. You will an integral member of a fast paced, Agile development and implementation team to architect, design and develop data integration solutions (Extract, Transform, Load) to support a unified User Experience / User Interface (UX/UI) that provides a holistic single-pane-of-glass interface for an integrated solution on the Elastic platform. You will also work with operational end users and support teams to perform requirements analysis, as well as design, develop and demonstrate mockups and wireframes.

Candidate must be within driving distance of Scott AFB. At a minimum, a Secret clearance is required upon the start of employment and within 14 days following the start date the employee must obtain their Security + certification.

Primary Responsibilities

• Designs, builds, and maintains scalable, reliable data systems and pipelines to ingest, process, and transform large, complex, and disparate data sources for analytics and reporting.
• Unifies and integrates data from multiple network operations systems into a consistent, accessible platform, ensuring data quality, accuracy, security, and compliance with DoD and DISA requirements.
• Implements solutions using Confluent Kafka, Elastic Stack, AWS, and Red Hat OpenShift (Kubernetes), including creating Kafka, Elastic, and Logstash pipelines and supporting Kibana visualizations and dashboards with React, JavaScript, and HTML.
• Develops and manages data warehouses and data lakes to support analytics, reporting, and operational dashboards, optimizing infrastructure for performance, scalability, and cost-effectiveness through automation and best practices.
• Continually analyze and optimize ingestion throughput, query performance, indexing strategies, and storage efficiency across Elastic and Kafka platforms.
• Automates data-related tasks such as ETL/ELT processes, data validation, cleansing, monitoring, and supports CI/CD pipelines for automated build, test, and deployment.
• Collaborates with data analysts, visualization engineers, and other stakeholders to deliver integrated, actionable data solutions, and documents data architecture, integration patterns, and operational procedures.
• Troubleshoots and resolves issues related to data ingestion, processing, and platform performance, storage, memory, partitioning, and cluster performance.

Basic Qualifications

• Bachelor’s degree in Computer Science, Engineering, or related technical discipline and 4+ years of relevant experience.
• Hands-on experience designing, building, and maintaining data pipelines (ETL/ELT) and integrating multiple, disparate data sources.
• Experience with data warehouse and/or data lake technologies (e.g., AWS Redshift, S3, Hadoop, Snowflake, or similar).
• Proficiency with data engineering tools and languages such as Python, Java, SQL, and shell scripting.
• Experience with Elastic Stack (Elasticsearch, Logstash, Kibana) and/or Kafka for data ingestion and processing.
• Familiarity with network operations data (logs, metrics, events, ticketing, CMDB) and related data models.
• Experience with Linux/UNIX system administration and automation.
• Knowledge of data security, access controls, and compliance frameworks (DoD, DISA, RMF, STIGs).
• Experience with CI/CD pipelines, containerized pipelines, version control (Git, Bitbucket), and DevOps practices.
• Strong communication and documentation skills for collaboration and knowledge sharing.
• Must be able to commute to Scott AFB, IL for up to full-time onsite support.
• Ability to obtain interim Secret DoD Security clearance before the start date.
• Ability to obtain Security+ certification or equivalent DoD 8570 IAT II certification within 14 days of the start date.

Preferred Qualifications

• Experience with DISA, DISN, or other DoD network environments, including developing and deploying software applications that meet DoD security standards (e.g., STIGs), and knowledge of network security, encryption, and access controls in classified environments.
• Experience with big data technologies and platforms such as Kafka, Spark, NiFi, Hadoop, Elasticsearch, Logstash, Databricks, and ELK Stack for text mining, summarization, search, and entity extraction.
• Experience with cloud-based data platforms (AWS, Azure, GCP, AWS GovCloud), cloud-integrated platforms, and infrastructure as code, including networking and security policies.
• Familiarity with Kubernetes deployment, platform upgrades, patching, configuration management tools (Ansible, Puppet, Chef), and monitoring, alerting, and observability tools (Prometheus, Grafana, Elastic).
• Experience with BI tools like Kibana and developing and maintaining technical documentation and runbooks.
• Strong understanding and practical experience with Agile methodologies (Scrum, SAFe), and related tools such as Atlassian JIRA and Confluence.
• Certified Confluent Developer and Certified Elastic Engineer.
• Excellent communication and collaboration skills, with experience working remotely with geographically dispersed teams and within a matrixed organization to combine software, integration, and data engineering practices.
• Apply knowledge of system architecture, networks, and centralized logging (ELK) to support data transformation initiatives.

Pay Range

Pay Range $87,100.00 - $157,450.00

About Leidos

Leidos is an industry and technology leader serving government and commercial customers with smarter, more efficient digital and mission innovations. Headquartered in Reston, Virginia, with 47,000 global employees, Leidos reported annual revenues of approximately $16.7 billion for the fiscal year ended January 3, 2025. For more information, visit www.Leidos.com.

Pay and Benefits

Pay and benefits are fundamental to any career decision. That's why we craft compensation packages that reflect the importance of the work we do for our customers. Employment benefits include competitive compensation, Health and Wellness programs, Income Protection, Paid Leave and Retirement. More details are available at www.leidos.com/careers/pay-benefits.

Commitment to Non-Discrimination

All qualified applicants will receive consideration for employment without regard to sex, race, ethnicity, age, national origin, citizenship, religion, physical or mental disability, medical condition, genetic information, pregnancy, family structure, marital status, ancestry, domestic partner status, sexual orientation, gender identity or expression, veteran or military status, or any other basis prohibited by law. Leidos will also consider for employment qualified applicants with criminal histories consistent with relevant laws.