ETL Engineer – TS/SCI with Polygraph Required

Core Interface Corporation; Virginia, Northern (IL, KY); Hybrid; USD 120,000 - 180,000; Full time

Benefits offered by this job

Medical benefits

401(k)

Paid time off

Parental leave

Tuition assistance

Internet reimbursement

Spot awards

Team events

Job summary

Core Interface Corporation seeks an ETL Engineer to design, build, and optimize data pipelines supporting mission-critical federal programs. You will own the data lifecycle from ingest through delivery in a Linux-based Big Data environment, ensuring robust data flow and documentation.

You will collaborate with data scientists and analysts, apply regex parsing, and leverage ELK, Spark, Airflow, and cloud services to enable scalable analytics and secure data handling in a TS/SCI setting.

Qualifications

• Active TS/SCI with Polygraph
• Bachelor’s degree in Computer Science, Engineering, or related technical field
• Strong Python and/or Java development skills with significant SQL and database experience
• Hands-on experience building ETL pipelines in a Linux-based Big Data environment
• Experience parsing using Regular Expressions
• Experience with ELK Stack
• Familiarity with RESTful API integration and data source consumption
• Clear communication skills in collaborative engineering environments

Responsibilities

• Design, build, and optimize ETL pipelines for large-scale data ingestion and transformation
• Develop custom solutions to ingest, profile, and exploit new and existing data sources
• Collaborate with data scientists and analysts to support model development and analytical workflows
• Maintain comprehensive data layer documentation for the broader engineering team
• Manage all stages of the data lifecycle from ingest planning through display
• Collaborate with teammates, service providers, vendors, and mission users to develop more efficient methods
• Identify and communicate risks, constraints, and tradeoffs in data architecture decisions

Skills

Python

Java

SQL

Regular Expressions

ELK Stack

RESTful API integration

Communication

Education

Bachelor’s degree in Computer Science, Engineering, or related technical field

Tools

Docker

Kubernetes

Apache Airflow

Apache Spark

Databricks

Hadoop

HBase

MapReduce

Job description

ETL Engineer - TS/SCI with Polygraph Required

• Full Time

About the Team

At Core Interface, we believe great software is built by small teams of thoughtful engineers working on meaningful problems.
Our work supports mission-critical federal programs where the quality and reliability of the data layer directly determines mission outcomes.

We’re growing our data engineering team and are looking for ETL-focused engineers across multiple experience levels who take real ownership of the data lifecycle - from ingest through delivery - and communicate clearly about architecture tradeoffs.

What You’ll Do in This Role

• Design, build, and optimize ETL pipelines for large-scale data ingestion and transformation
• Develop custom solutions to ingest, profile, and exploit new and existing data sources
• Collaborate with data scientists and analysts to support model development and analytical workflows
• Maintain comprehensive data layer documentation for the broader engineering team
• Manage all stages of the data lifecycle from ingest planning through display
• Collaborate with teammates, service providers, vendors, and mission users to develop more efficient methods
• Identify and communicate risks, constraints, and tradeoffs in data architecture decisions

Required Qualifications

• Active TS/SCI with Polygraph
• Bachelor’s degree in Computer Science, Engineering, or related technical field
• Strong Python and/or Java development skills with significant SQL and database experience
• Hands-on experience building ETL pipelines in a Linux-based Big Data environment
• Experience parsing using Regular Expressions
• Experience with interacting with the ELK Stack
• Familiarity with RESTful API integration and data source consumption
• Clear communication skills in collaborative engineering environments

Additional Strengths That Stand Out

• Experience with cloud data platforms (AWS Glue/S3, Azure Data Factory/Synapse, Snowflake, Databricks)
• Experience with Apache Spark or similar distributed processing frameworks
• Experience with pipeline orchestration tools such as Apache Airflow or equivalent
• Experience with Hadoop, HBase, and MapReduce
• Prior work in a mission environment or with diverse, complex data types
• Containerization experience with Docker and/or Kubernetes

Core Interface Benefits

• 100% employer-paid medical, dental, and vision (employee + family)
• 401(k) with 6% company contribution
• 4 weeks PTO plus 11 federal holidays
• Paid parental leave
• Government shutdown protection
• Tuition assistance and technical training
• Internet, phone, and fitness reimbursements
• Referral bonuses and spot awards
• Quarterly team events

Commitment to Inclusion

Core Interface is an Equal Opportunity / Aff…