Observability Platform Engineer/DevOps

Cloud Hybrid Technologies, LLC; Atlanta (GA); On-site; USD 120,000 - 180,000; Full time

Job summary

A technology solutions provider is seeking to lead the architecture and implementation of a comprehensive observability strategy across a SIEM modernization ecosystem. Responsibilities include designing telemetry for data visibility, developing fault-detection dashboards, and ensuring the integration of monitoring solutions with Grafana and Azure Monitor. This position involves close collaboration with Security Engineering and Data Engineering teams to create actionable insights that drive improvements. Candidates should have experience in observability tools and data engineering.

Responsibilities

• Lead the architecture and implementation of observability solutions across the SIEM modernization ecosystem.
• Design and build telemetry for data events ensuring real-time visibility.
• Develop and maintain dashboards to detect faults and throughput bottlenecks.
• Instrument each pipeline component with performance metrics.
• Ensure observability for Azure Event Hubs including monitoring events and lag.
• Monitor Blob storage utilization for issues and gaps.
• Implement correlation IDs to trace data within pipelines.
• Integrate monitoring solutions with various platforms for stakeholder needs.
• Collaborate with engineering teams to enhance observability insights.

Skills

Observability strategy

Telemetry and traceability

Dashboard development

Monitoring solutions integration

Collaboration with engineering teams

Tools

Grafana

Azure Monitor

PowerBI

Cribl

Vector

NiFi

Splunk

Snowflake

Blob storage

Job description

Responsibilities

• Lead the architecture and implementation of a comprehensive observability strategy across the entire SIEM modernization ecosystem, spanning data pipeline layers (Cribl, Vector, NiFi), event transport (Event Hubs), intermediate storage (Blob), and multiple downstream platforms (Splunk, Snowflake, ADX, Log Analytics, Anvilogic).
• Design and build end-to-end telemetry and traceability for data events as they move across platforms, enabling real-time visibility into ingestion, transformation, routing, and storage processes.
• Develop and maintain dashboards and alerting mechanisms to detect:
  • Faults and failures (e.g., dropped messages, ingestion lags, retry loops)
  • Latency or throughput bottlenecks across pipelines
  • Schema mismatches or format errors
  • Duplicate, delayed, or missing data
  • Data quality anomalies at point of ingestion and final storage
• Instrument each pipeline component (e.g., Cribl workers, Vector agents, NiFi processors) with health and performance metrics, using native exporters, APIs, or custom collectors.
• Ensure observability tooling is in place for Azure Event Hubs, including partition health, consumer group lag, and throttling events.
• Monitor Blob storage utilization and access patterns to identify ingest failures, access permission issues, or object lifecycle gaps.
• Implement and enforce correlation IDs or tracing metadata to follow data across systems and detect where in the pipeline an issue originates.
• Integrate monitoring solutions with Grafana, Azure Monitor, and PowerBI to support multiple stakeholder needs (technical, operational, and executive-level views).
• Partner closely with Security Engineering, Platform Engineering, and Data Engineering to ensure observability insights are actionable and result in measurable improvements.

Equal Opportunity Statement

Cloud Hybrid is an equal opportunity employer inclusive of female, minority, disability and veterans, (M/F/D/V). Hiring, promotion, transfer, compensation, benefits, discipline, termination and all other employment decisions are made without regard to race, color, religion, sex, sexual orientation, gender identity, age, disability, national origin, citizenship/immigration status, veteran status or any other protected status. Cloud Hybrid will not make any posting or employment decision that does not comply with applicable laws relating to labor and employment, equal opportunity, employment eligibility requirements or related matters. Nor will Cloud Hybrid require in a posting or otherwise U.S. citizenship or lawful permanent residency in the U.S. as a condition of employment except as necessary to comply with law, regulation, executive order, or federal, state, or local government contract