Senior Data Engineer (TS/SCI) – AWS & Pipelines

Cornerstone Defense LLC; Herndon (VA); On-site; USD 150,000 - 210,000; Full time

Benefits offered by this job

Medical, Dental and Vision Plans

401(k)

Generous PTO

Job summary

Cornerstone Defense LLC is actively seeking a Data Engineer Expert in Herndon, VA. You will design and maintain data pipelines, collaborate with development teams, and enable data-driven insights across large datasets.

The role requires strong Python, SQL, and AWS experience, plus a TS/SCI with Polygraph clearance. Ideal candidates have 8+ years of pipeline experience, with hands-on work in Linux, SPARC environments, and relational databases such as PostgreSQL, Oracle, or MySQL.

Qualifications

• Active TS/SCI with Polygraph clearance.
• Master's degree in Computer Science, Information Systems, Engineering, or related field.
• Build and maintain reliable data pipelines for ingestion, transformation and delivery of large datasets.
• Partner with software developers to integrate data solutions into existing systems.
• Develop and optimize SQL queries for data retrieval and analysis.
• Work with relational databases like PostgreSQL, Oracle, and MySQL.
• Develop scripts using Python, Linux, and shell scripting for data processing tasks.
• Operate within AWS environments for cloud-based data infrastructure.
• Prepare data outputs in usable formats including JSON.
• 8+ years of experience in developing or maintaining data pipelines with development teams.
• 4+ years of Python experience.
• Experience with AWS cloud services.
• Experience with SPARC environments and relational databases.
• Experience writing and maintaining SQL queries.
• 4+ years of Linux experience, including shell scripting.
• Experience handling structured and unstructured data, including JSON formats.
• Excellent communication and collaboration skills.
• Experience with Apache NiFi or Apache Airflow.
• 4+ years development experience with Java or Scala.
• Experience managing or supporting EMR or SPARC clusters.
• Performance tuning and optimization of data pipelines or large data systems.
• 4+ years working with Hive or Iceberg.
• Familiarity with cloud-based security practices.
• Experience using ACM processes for code deployment.

Responsibilities

• Design and maintain data pipelines to support ingestion, transformation and delivery of large datasets.
• Collaborate with software developers and engineering teams to integrate data solutions into existing systems.
• Develop and optimize SQL queries for data retrieval and analysis.
• Work with PostgreSQL, Oracle, and MySQL to store and access data.
• Create scripts and automation with Python, Linux and shell scripting for data processing tasks.
• Operate within AWS environments for cloud-based data infrastructure.
• Prepare and structure data outputs including JSON for analysis and downstream systems.
• Support data pipeline development in collaboration with development teams.

Skills

Excellent communication

Collaboration

Problem solving

Education

Master's degree in CS/IS/Engineering

Tools

Python

Linux

Shell scripting

SQL

AWS

PostgreSQL

Oracle

MySQL

JSON

Apache NiFi

Apache Airflow

Java

Scala

EMR

SPARC

Hive

Iceberg

Job description

Cornerstone Defense LLC is actively seeking a Data Engineer Expert in Herndon, VA. You will design and maintain data pipelines, collaborate with development teams, and enable data-driven insights across large datasets.

The role requires strong Python, SQL, and AWS experience, plus a TS/SCI with Polygraph clearance. Ideal candidates have 8+ years of pipeline experience, with hands-on work in Linux, SPARC environments, and relational databases such as PostgreSQL, Oracle, or MySQL.