Senior Data Engineer - Security Telemetry Pipelines

TechDigital Group; Frisco (TX); On-site; USD 110,000 - 140,000; Full time

Job summary

A leading tech company in the US is looking for a Senior Data Engineer to design and implement scalable data flow pipelines. The candidate will manage complex security telemetry data, ensuring secure data movement and transformation. Proficiency in tools like Cribl, Apache NiFi, and programming languages such as Python or JavaScript is essential. This role offers a chance to lead innovative solutions in the cybersecurity domain.

Qualifications

• Experience leading data flow architecture and implementation.
• Expertise in ingestion frameworks for diverse input and output types.
• Strong understanding of data governance and security controls.

Responsibilities

• Lead architecture and design of data flow pipelines.
• Develop platform-agnostic ingestion frameworks.
• Implement custom data transformations and enrichments.
• Ensure traceability and lineage of data across pipelines.

Skills

Data flow architecture

Cribl

Apache NiFi

Python

Groovy

JavaScript

Data governance

Security controls

Tools

Cribl

Apache NiFi

Vector

Snowflake

Splunk

Job description

A leading tech company in the US is looking for a Senior Data Engineer to design and implement scalable data flow pipelines. The candidate will manage complex security telemetry data, ensuring secure data movement and transformation. Proficiency in tools like Cribl, Apache NiFi, and programming languages such as Python or JavaScript is essential. This role offers a chance to lead innovative solutions in the cybersecurity domain.