A leading technology firm in Bellevue, WA is seeking a professional to enhance the Azure Data Explorer architecture. Responsibilities include validating architecture, integrating data pipelines, and maintaining query languages for data analysis. The ideal candidate has strong skills in Azure technologies and experience in data governance. This is a full-time position that promises significant opportunities for growth and impact.
Responsibilities
Review and validate the ADX architecture for scalability and performance.
Ensure integration of data pipelines ensuring high throughput and fault tolerance.
Develop and maintain KQL functions and materialized views.
Monitor all data ingestion flows for issues.
Build dashboards for data quality monitoring.
Implement data normalization practices.
Configure role-based access control.
Provide cost visibility and optimization strategies.
Skills
Azure Data Explorer (ADX)
Kusto Query Language (KQL)
Data Pipeline Integration
Monitoring and Alerting
Data Normalization
Role-Based Access Control (RBAC)
Job description
Responsibilities
Review and validate the Azure Data Explorer (ADX) architecture to ensure scalability, resiliency, and performance. Recommend and implement approved changes to cluster sizing, partitioning strategies, and cache policies.
Ensure integration of data pipelines such as Vector, Event Hubs, Azure Blob, Cribl, NiFI ensuring high throughput and fault tolerance.
Develop and maintain Kusto Query Language (KQL) functions, materialized views, and time-series optimizations to support advanced querying and SIEM use cases.
Ensure all data ingestion flows are monitored end-to-end, with alerting and logging for failures, latency issues, or schema mismatches.
Build and maintain data quality monitoring dashboards to identify missing, delayed, malformed, or duplicate events, and proactively address anomalies.
Implement and document data normalization practices, including alignment with schema standards like OCSF when applicable.
Configure and maintain role-based access control (RBAC) and ensure compliance with corporate data governance and security standards.
Provide cost visibility and optimization strategies, including usage tracking, retention tuning, and query performance analysis.