A technology company in Arlington, VA is seeking an experienced Data Engineer to lead the development and operation of data infrastructure for cyber operations. The ideal candidate has over 8 years of experience in data engineering and ETL pipeline construction, with expertise in data lake architecture and proactive leadership skills. This role requires a focus on national security outcomes and the ability to work closely with engineers and analysts. An active TS/SCI security clearance is required, with occasional travel to Fort Meade, MD.
Qualifications
8+ years of experience in data engineering and/or data architecture.
Expertise in building ETL pipelines and operating them in production.
Deep experience with data lake architecture and querying systems.
Strong schema and index design skills.
Experience with column-oriented databases in production environments.
Proven leadership experience.
Responsibilities
Lead development and operation of a data lake for cyber operations.
Design schemas and indexes for complex datasets.
Partner with engineers to define query patterns for mission use cases.
Build observable and resilient ETL pipelines.
Establish best practices for data quality and documentation.
Mentor engineers on data modeling and performance tuning.
Skills
Data modeling
Schema design
ETL pipeline construction
Operational excellence
Collaboration with engineers
Leadership
Tools
Apache Iceberg
Delta Lake
AWS Athena
Apache Spark
ClickHouse
Neo4j
Job description
A technology company in Arlington, VA is seeking an experienced Data Engineer to lead the development and operation of data infrastructure for cyber operations. The ideal candidate has over 8 years of experience in data engineering and ETL pipeline construction, with expertise in data lake architecture and proactive leadership skills. This role requires a focus on national security outcomes and the ability to work closely with engineers and analysts. An active TS/SCI security clearance is required, with occasional travel to Fort Meade, MD.