Cybersecurity Data Engineer & Pipeline Specialist

Sharp Decisions; Charlotte (NC); Hybrid; USD 90,000 - 150,000; Full time

Job summary

Sharp Decisions seeks a Cyber Security Engineer – Data Engineer, Associate to join the Cyber Security Operations team. You will design, build, and maintain scalable data ingestion pipelines for security telemetry across Azure Data Explorer, Log Analytics, and cloud/on‑prem environments.

You will partner with application, infrastructure, security, and governance teams to ensure telemetry is collected, normalized, validated, and available for threat detection, incident response, and risk

Qualifications

• Minimum of 3 years in cybersecurity, data engineering, log management, or related tech.
• Hands-on onboarding, managing, and validating log sources in SIEM or cloud data platforms.
• Strong parsing, normalization, transformation, and validation techniques (regex, JSON, XML, CSV).
• Familiarity with network, endpoint, identity, application, cloud, and infrastructure logs.
• Experience with cloud logging, monitoring, and analytics services.
• Ability to troubleshoot data pipelines, schema issues, and data quality defects.

Responsibilities

• Design, build, and maintain scalable data ingestion pipelines for onboarding security log sources into SIEM and cloud data platforms, including Azure Data Explorer and Log Analytics.
• Parse, normalize, transform, and enrich structured and unstructured log data using regex, JSON parsing, schema mapping, and data validation.
• Onboard new log sources and confirm end-to-end data flow with stakeholders across teams and vendors.
• Validate log integrity, completeness, timeliness, and quality for monitoring, detection, response, and reporting use cases.
• Align onboarded data to standards, schemas, naming conventions, and data governance expectations.
• Troubleshoot ingestion, parsing, transformation, and pipeline issues across diverse log sources and environments.
• Develop and maintain documentation for log onboarding, data mappings, source requirements, and configurations.
• Collaborate with detection engineering and SOC teams to support threat detection and cyber risk visibility.
• Conduct telemetry gap analysis; recommend onboarding priorities to improve security coverage.
• Support logging and data collection practices aligned with regulatory, audit, retention, and integrity requirements.
• Improve ingestion frameworks, automation, and onboarding workflows for efficiency and cost effectivity.
• Support infrastructure-as-code, scripting, and automation to streamline deployment and maintenance.
• Monitor pipeline performance and optimize ingestion reliability, throughput, and cost.
• Stay current on logging standards, telemetry formats, and cloud security data platform capabilities.

Skills

Data ingestion

Data parsing

Data normalization

Data validation

Threat detection

Incident response

Cloud security

Regulatory compliance

Scripting

Cross-functional collaboration

Tools

Azure Data Explorer

Log Analytics

Python

PowerShell

Job description

Sharp Decisions seeks a Cyber Security Engineer – Data Engineer, Associate to join the Cyber Security Operations team. You will design, build, and maintain scalable data ingestion pipelines for security telemetry across Azure Data Explorer, Log Analytics, and cloud/on‑prem environments.

You will partner with application, infrastructure, security, and governance teams to ensure telemetry is collected, normalized, validated, and available for threat detection, incident response, and risk