Job Title
CyberSecurity Data Engineering Lead
Location
Remote
Job Description
Our client, CyberSecurity is seeking a CyberSecurity Data Engineering Lead to join their team. As a CyberSecurity Data Engineering Lead, you will be part of the Compliance & Security Data Engineering team supporting the Compliance Data Platform initiative. The ideal candidate will have a strong drive to build reliable data pipelines, a collaborative mindset to translate security and compliance needs into measurable logic, and the ability to deliver production-ready engineering through disciplined SDLC practices.
Responsibilities
- Build & operate the compliance data foundation as a principal individual contributor, advancing newly acquired compliance and security datasets into high-utility data products that measure and monitor control performance and effectiveness.
- Implement and maintain end-to-end Databricks ETL pipelines, transforming raw data into structured, standardized compliance datasets that are ready for consumption and analysis.
- Design, optimize, and run Medallion data pipelines (Bronze, Silver, and Gold) to ensure raw, conformed, and consumption-ready compliance data layers are consistent, reliable, and scalable.
- Normalize core security and compliance data by developing data normalization schemas for high-volume telemetry feeds ingested from tools such as ServiceNow, Microsoft Defender, CrowdStrike, Zscaler, Wiz, Microsoft Entra ID, SailPoint, and others.
- Transform telemetry into monitored logic by partnering with data source and control domain owners to translate datasets into monitoring enablement and programmatic control-testing logic embedded directly in the data layer.
Requirements
- Bachelor’s degree with 5–8 years of experience across a hybrid of Cyber Security Operations (e.g., threat detection engineering, security telemetry analysis) and Security Compliance/GRC roles.
- Advanced Databricks engineering expertise, including building ETL pipelines, orchestrating data workflows, and developing analytics in Databricks; experience developing, deploying, or managing custom Databricks applications or Databricks Agents is a strong plus.
- Proven capability to normalize, correlate, and test data structures sourced from security, identity, and governance platforms (ServiceNow, Defender, CrowdStrike, Zscaler, Wiz, Entra ID, SailPoint).
- Solid understanding of security compliance frameworks and policy-to-control translation logic, with experience deploying continuous control monitoring (CCM) strategies within a secure cloud data lake.
- Hands-on Agile SDLC experience, including Git/GitHub version control, peer review cycles, and release testing/approval gates; strong communication skills to bridge complex engineering requirements with business-facing risk management objectives.
What’s in it for me?
Own the engineering of compliance data products that directly support control performance measurement and monitoring. Build robust Databricks ETL pipelines and Medallion-layer architectures that turn raw telemetry into structured, standardized datasets. Collaborate with security and control domain owners to embed monitoring and control-testing logic directly into the data layer. Develop high-insight compliance dashboards, reports, and analytic applications that reveal coverage gaps and operational effectiveness. Strengthen your SDLC and release discipline through GitHub-based workflows, automated job monitoring, exception handling, and reliable promotion into production.
Benefits
- Medical and Prescription Drug Plans
- Dental Plan
- Vision Plan
- Health Savings Account
- Health Flexible Spending Account
- Dependent Care Flexible Spending Account
- Supplemental Life Insurance
- Short Term and Long Term Disability Insurance
- Business Travel Insurance
- 401(k), Plus Match
- Weekly Pay