Data Engineer with Security Clearance

Cornerstone Defense; Chantilly (VA); On-site; USD 120,000 - 190,000; Full time

Benefits offered by this job

Medical, Dental, Vision plans

Generous PTO policy

401(k) retirement plan

HSA and FSA options

Life and Disability Insurance

Tuition Reimbursement

Job summary

Cornerstone Defense is seeking a Data Engineer in Chantilly, VA to develop and optimize data pipelines, ingest and transform diverse data types, and collaborate with data scientists and partners to deliver actionable insights for mission objectives.

The role focuses on building ETL processes, ensuring data quality and provenance, and supporting both cloud and on-prem data platforms using Spark, OpenSearch, NiFi, and related tools. Security clearance is required.

Qualifications

• Experience building and maintaining ETL pipelines across structured and unstructured data.
• Strong knowledge of data modeling, governance, and provenance to protect data access.
• Proficiency with Python, SQL and Spark in cloud/on-prem environments.
• Familiarity with open source data tooling such as ElasticSearch and NiFi.

Responsibilities

• Design and optimize data pipelines using Spark, OpenSearch, and NiFi.
• Transform and ingest data from diverse sources for analytics and mission objectives.
• Collaborate with data scientists and partners to define data formats and transforms.
• Maintain data quality and provenance across enterprise data stores.
• Develop documentation for ETL mappings, code usage, and access instructions.
• Support data engineers and software teams in integrating new data processing platforms.

Skills

Data lifecycle engineering

ETL tools development

Cloud + on-prem data storage

Python

SQL

Spark

Data engineering programming

ElasticSearch

NiFi

Agile lifecycle

Tools

ElasticSearch

NiFi

Spark

EMR

Kubernetes

Job description

Title: Data Engineer Location: Chantilly, VA

• Clearance:
• Active TS/SCI w/ Polygraph needed to apply
• Company Overview: Cornerstone Defense is the Employer of Choice within the Intelligence, Defense, and Space communities of the U.S. Government. Realizing early on that our most prized assets are our employees, we continually focus our attention on improving the overall work/life experience they have supporting the mission. Our Team is pushed every day to use their industry leading knowledge to provide end-to-end solutions to combat our nation's toughest and most secure problems. If you are looking for a place to not only be professionally challenged, but encouraged and supported by a company that cares, don't look any further than Cornerstone Defense. Benefits Overview : Cornerstone Defense offers a very comprehensive benefits package including, but not limited to: Medical, Dental and Vision Plans
• Generous PTO Policy
• 401(k)
• HSA and FSA options
• Life and Disability Insurance
• Tuition Reimbursement and Training
• Perks at Work Discount Program
• Referral Program
• Leads Generation Program
• CollegeAmerica 529
• Fitness Reimbursement Program
• Travel Assistance
• Norton Lifelock Benefit Solutions
• Life Planning Financial & Legal Services
• Develop new tools, code, and services to execute data engineering activities involving data of varying types and in varying conditions. Activities include the following tasks: Movement of structure and unstructured data using approved methods. Execute data ingestion activities for storing data in a local or enterprise level location. Develop code to format data that supports exploration. Analyze source data formats and work with Data Scientists and partners to determine the formats and transforms that best meet mission objectives. Develop code and tools to provide one-time and on-going data extraction from various repositories, formatting and transformations into enterprise or standalone data models. Develop new ETL and perform O&M and enhancements on existing ETL code using best practices/standards. Develop and deliver documentation for each project including ETL mappings, code use guide, code location and access instructions.
• Design and optimize Data Pipelines using tools such as Spark, Apache Iceberg, Trino, OpenSearch, EMR cloud services, NiFi and Kubernetes containers
• Ensure the pedigree and provenance of the data is maintained such that the access to data is protected
• Clean and preprocess data to enable access for advanced analytics
• Collaborate with enterprise working groups to advance the state of data standards
• Collaborate with the engineering team, data stewards, and mission partners to aid in getting actionable value out of the data holdings
• Collaborate with software engineers to update, configure, and maintain data services based on the requirements
• Ensure data quality by working with the testing and data quality team to enhance standardization of data conditioning pipelines
• Experience adapting to various types and formats of data, and working with development teams to integrate new data processing platforms Required Skills:
• 10+ years experience with:
• Data lifecycle engineering
• Development and maintenance of extract, transform and load (ETL) tools and services
• Cloud and on-prem data storage and processing solutions
• Python, SQL, Spark and other data engineering programming
• COTS and open source data engineering tools such as ElasticSearch and NiFi
• Processing data within the Agile Lifecycle