Staff Data Engineer: Data Lake & Cyber Ops Lead

Twenty; New York (NY); On-site; USD 120,000 - 150,000; Full time

Benefits offered by this job

Health insurance

Paid parental leave

Flexible PTO

401(k) retirement plan

Commuter benefits

Job summary

Twenty in New York is seeking a Data Engineer to own the infrastructure for cyber operations applications. You'll build a high-performance data lake and collaborate with engineers, overseeing the development of ETL pipelines to handle high-volume datasets efficiently.

Your role will require leadership to mentor engineers, ensure data reliability, and drive key technical initiatives. A focus on national security outcomes is essential.

Qualifications

• 8+ years of experience in data engineering and/or data architecture.
• Mastery-level expertise in building ETL pipelines in production.
• Deep experience with data lake architecture.
• Strong schema and index design skills.
• Experience with column-oriented databases in production.
• Experience building data systems from scratch.
• Proven leadership experience.

Responsibilities

• Lead the development of a data lake for cyber operations.
• Design schemas and indexes for complex datasets.
• Partner with teams to define query patterns for mission use.
• Build observable and resilient ETL pipelines.
• Establish best practices for data quality.
• Mentor engineers on data modeling.

Skills

Data modeling

Schema and index design

ETL pipeline development

Data quality and lineage

Collaboration

Tools

Apache Iceberg

Delta Lake

Apache Hive

Trino

Apache Spark

Job description

Twenty in New York is seeking a Data Engineer to own the infrastructure for cyber operations applications. You'll build a high-performance data lake and collaborate with engineers, overseeing the development of ETL pipelines to handle high-volume datasets efficiently.

Your role will require leadership to mentor engineers, ensure data reliability, and drive key technical initiatives. A focus on national security outcomes is essential.