Senior Data Engineer - Secret Clearance

LaunchCode; St. Louis (MO); On-site; USD 85,000 - 130,000; Full time

Job summary

LaunchCode through a partner organization is seeking a highly skilled Data Engineer to design, develop, and maintain scalable data infrastructure supporting enterprise analytics for defense-related projects. The role focuses on end-to-end data pipelines, data quality, and integration of large datasets to enable BI and decision-making.

The ideal candidate will have strong SQL, Python, Databricks, Spark, and ETL experience, with a background in federal data environments and BI tool exposure.

Qualifications

• U.S. citizenship and an active Secret clearance required.
• Strong SQL skills with ability to write and troubleshoot complex queries.
• Experience with ETL processes and data ingestion workflows.
• Experience integrating data from multiple sources and big datasets.
• Hands-on programming with Python.
• Experience with Spark/Scala/JSON and SQL.
• Experience developing BI reports, dashboards, and analytics.

Responsibilities

• Design, develop, and maintain end-to-end data pipelines using ETL processes.
• Build scalable pipelines with Databricks, Python, Spark, Scala, JavaScript/JSON, SQL, and Jupyter Notebooks.
• Create and optimize data pipelines to support analytics and reporting.
• Perform data cleansing, transformation, integration, and quality assurance on large datasets.
• Process large datasets in DoD environments and supporting BI solutions.
• Collaborate with stakeholders to understand data requirements and design data models.
• Provide data for reporting, analytics, and decision-making.
• Maintain documentation for pipelines and workflows.
• Evaluate new data engineering technologies and promote best practices.

Job description

Brief Description

Position Type: Direct Hire / Full-Time

Location: Shiloh, IL / On-site at Scott Air Force Base

Schedule: On-site, generally 9:00 AM–5:00 PM depending on project needs

Clearance: Active Secret Clearance Preferred

Years of Experience: 10+

Hiring Timeline: Immediate

Compensation: $85,000–$130,000/year

Company: The name of our partner organization will be disclosed during the interview process. This is not a direct role with LaunchCode; it is a position through LaunchCode, working with one of our partner companies.

Position Overview

Our partner is seeking a skilled and highly motivated Data Engineer to support an expanding portfolio of data and technology initiatives within the Defense sector.

The Data Engineer will be responsible for designing, developing, and maintaining scalable cloud and data infrastructure that supports enterprise analytics, reporting, and operational decision-making. This role will focus heavily on building and optimizing end-to-end data pipelines, integrating large and complex datasets, improving data quality, and supporting business intelligence and analytics solutions.

The ideal candidate brings strong experience with ETL processes, SQL, Python, Databricks, Spark, and modern data engineering practices. Experience working with Department of Defense data environments, business intelligence platforms, and large-scale federal datasets is highly preferred.

Position Responsibilities

• Design, develop, and maintain end-to-end data pipelines using ETL processes and modern data engineering technologies.
• Build scalable and reliable data pipelines using technologies such as Databricks, Python, Spark, Scala, JavaScript/JSON, SQL, and Jupyter Notebooks.
• Create and optimize data pipelines from the ground up to support high-performance data processing and analytics.
• Perform data cleansing, transformation, integration, and quality assurance activities to maintain the accuracy and integrity of large datasets.
• Process and analyze large-scale datasets using big data technologies within federal and Department of Defense environments.
• Troubleshoot data-related issues and develop practical solutions to complex data challenges.
• Implement and support data governance policies, standards, and procedures to promote data integrity and regulatory compliance.
• Collaborate with technical and business stakeholders to understand data requirements and design effective data models and architectures.
• Partner with data scientists, analysts, and business teams to provide accurate and timely data for reporting, analytics, and decision-making.
• Develop and maintain business intelligence reports, applications, dashboards, and data visualizations.
• Maintain technical documentation for data pipelines, software applications, workflows, and related processes.
• Evaluate emerging data engineering technologies and recommend tools, platforms, and approaches that improve performance, scalability, and automation.
• Support continuous improvement of enterprise data environments, reporting processes, and analytics capabilities.

Required Skills/Experience

• U.S. citizenship and an active Secret clearance. Clearance sponsorship may be available for qualified candidates.
• Strong SQL skills with the ability to write, troubleshoot, and modify complex queries and procedures across multiple datasets.
• Experience with Extract, Transform, Load (ETL) processes, including building and maintaining data ingestion and transformation workflows.
• Experience integrating, manipulating, and combining data from multiple structured and unstructured sources.
• Hands-on programming and data engineering experience with Python and related technologies.
• Experience with technologies such as Spark, Scala, JavaScript/JSON, and SQL.
• Experience developing and supporting business intelligence applications, reports, dashboards, and analytical solutions.
• Familiarity with business intelligence platforms such as Cognos Analytics, Qlik Sense, and Power BI.
• Experience working with large datasets and applying big data technologies to support scalable data processing and analysis.
• Strong analytical and problem-solving skills with the ability to troubleshoot complex data issues.
• Ability to work effectively with cross-functional technical and business teams.
• Strong written and verbal communication skills.
• Detail-oriented approach with a commitment to data quality and reliable technical delivery.

Preferred Qualifications

• Experience with Databricks and modern cloud-based data engineering environments.
• Familiarity with Amazon Web Services, including AWS and Amazon S3.
• Experience working with Jupyter Notebooks.
• Understanding of data modeling, data visualization, database design principles, and data governance practices.
• Experience with Teradata, including Multiload, BTEQ, or related Teradata utilities and procedures.
• Experience supporting Department of Defense or other federal agency data environments.
• Familiarity with Department of Defense financial or accounting systems such as DEAMS, TFMS, NERP, or similar platforms.
• Knowledge of Department of Defense accounting processes, transportation policies, or related operational environments.
• Experience supporting cloud modernization, data transformation, or analytics initiatives within a federal environment.

Benefits

• Health, vision, and dental plans for employees and their families.
• Competitive 401(k) plan with 100% company matching on employee contributions up to the first 6%.
• Generous paid time off based on length of service.
• Bonus opportunities based on individual performance and achievement of goals.
• Professional development support through training programs and certifications.
• Company-sponsored team-building activities, retreats, and professional conferences.