Data Engineer (Cyber Security)

TechDigital Corporation

Overland Park (KS)

On-site

USD 120,000 - 190,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

TechDigital Corporation in Overland Park, KS seeks a Senior Data Engineer to architect and optimize security telemetry data flows across multiple sources and destinations. You will drive end-to-end ingestion, transformation, and validation, leveraging Cribl, Vector, and open-source tools.

Responsibilities include implementing schema normalization with OC SF, building robust data transformations, and ensuring governance, security, and audit readiness across the platform.

Qualifications

  • 10 Years of experience in Cybersecurity.
  • 5 Years of experience on CRIBL/Vector/Datadog/Splunk or other data pipeline platforms.
  • 5 Years of experience on JavaScript, Python, or other scripting language.

Responsibilities

  • Lead the architecture, design, and implementation of scalable, modular data flow pipelines using Cribl, Vector, and other open-source platforms.
  • Develop platform-agnostic ingestion frameworks and templates to enable reusable ingestion patterns for diverse input types and destinations.
  • Spearhead a schema normalization strategy using OC SF, with field mapping, transformation templates, and portable schema validation.

Skills

Data pipeline architecture
Security telemetry
Scripting (Groovy, Python, JavaScript)
Open-source platforms

Tools

Cribl
Vector
Datadog
Splunk
Snowflake
ADX
Log Analytics

Job description

Job Description

Job Description Position Details

We are seeking Senior Data Engineers to lead efforts in orchestrating and transforming complex security telemetry data flows.

These individuals will be responsible for high-level architecture and ensuring secure and reliable movement of data between systems, particularly for legacy and non-standard log sources.

There are 100 data sources including existing and new that are specific to Cyber Security workloads that are in-scope.

These tasks will be performed on one or more data ingestion pipelines (Cribl, Vector).

Work Required

  • "Lead the architecture, design, and implementation of scalable, modular, and reusable data flow pipelines using Cribl, Vector, and other open-source platforms, ensuring consistent ingestion strategies across a complex, multi-source telemetry environment."
  • "Develop platform-agnostic ingestion frameworks and template-driven architectures to enable reusable ingestion patterns, supporting a variety of input types (e.g., syslog, Kafka, HTTP, Event Hubs, Blob Storage) and output destinations (e.g., Snowflake, Splunk, ADX, Log Analytics, Anvilogic)."
  • "Spearhead the adoption of a schema normalization strategy, leveraging the Open Cybersecurity Schema Framework (OCSF), including field mapping, transformation templates, and schema validation logic designed to be portable across ingestion platforms."
  • "Design and implement custom data transformations and enrichments using scripting languages such as Groovy, Python, or JavaScript, while enforcing robust governance and security controls (SSL/TLS, client authentication, input validation, logging)."
  • "Ensure full end-to-end traceability and lineage of data across the ingestion, transformation, and storage lifecycle, including metadata tagging, correlation IDs, and change tracking for forensic and audit readiness."
  • "Collaborate with observability and platform teams to integrate pipeline-level health monitoring, transformation failure logging, and anomaly detection mechanisms."
  • "Oversee and validate data integration efforts, ensuring high-fidelity delivery into downstream analytics platforms and data stores, with minimal data loss, duplication, or transformation drift."
  • "Lead technical working sessions to evaluate and recommend best-fit technologies, tools, and practices for managing structured and unstructured security telemetry data at scale."
  • "Implement data transformation logic including filtering, enrichment, dynamic routing, and format conversions (e.g., JSON CSV, XML, Logfmt) to prepare data for downstream analytics platforms. (100 plus sources of data)"
  • "Contribute to and maintain a centralized documentation repository, including ingestion patterns, transformation libraries, naming standards, schema definitions, data governance procedures, and platform-specific integration details."
  • "Coordinate with security, analytics, and platform teams to understand use cases and ensure pipeline logic supports threat detection, compliance, and data analytics requirements."

Experience Required:

  • "10 Years of experience working in Cybersecurity"
  • "5 Years of experience on CRIBL/Vector/Datadog/Splunk or other data pipeline platforms"
  • "5 Years of experience on JavaScript, python, or other scripting language"
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Data Engineer – Cybersecurity
Data Engineer – Cybersecurity

TechDigital Group • Frisco (TX)

On-site
USD 110,000 - 140,000
Security Data Engineer
Security Data Engineer

TechDigital Group • Overland Park (KS)

On-site
USD 120,000 - 160,000
Data Engineer
Data Engineer

TechDigital Group • Bellevue (WA)

On-site
USD 100,000 - 140,000
Senior Automation Scientist - Drug Product Automation Leader
Senior Automation Scientist - Drug Product Automation Leader

TechDigital Group • New Brunswick (NJ)

On-site
USD 70,000 - 110,000
Data Engineer Expert
Data Engineer Expert

VT Group (VTG) • Herndon (VA)

On-site
USD 140,000 - 210,000
Cyber Security Engineer – Data Engineer
Cyber Security Engineer – Data Engineer

Sharp Decisions • Charlotte (NC)

Hybrid
USD 90,000 - 150,000
Cybersecurity Data Engineer
Cybersecurity Data Engineer

SPECIAL AEROSPACE SECURITY SERVICES INC • Fort Meade (MD)

On-site
USD 120,000 - 180,000
Senior Security Data Engineer � SIEM Data Pipeline
Senior Security Data Engineer � SIEM Data Pipeline

Danta Technologies • Bellevue (WA)

Hybrid
USD 150,000 - 190,000
Healthcare insurance
Paid holidays
Paid sick leave
Database Consultant
Database Consultant

GTT, LLC • Massachusetts

On-site
USD 100,000 - 142,000
Data Analysis Engineer - Enterprise Cybersecurity
Data Analysis Engineer - Enterprise Cybersecurity

Si Tec Consulting • Springfield (VA)

On-site
USD 110,000 - 160,000