observability engineer for AI agent platform

HireHi; United States; Remote; USD 120,000 - 190,000; Full time

Benefits offered by this job

Благополучие сотрудников

Профессиональный рост

Job summary

HireHi приглашает квалифицированного инженера по наблюдаемости и SRE для поддержки крупной глобальной платформы Аgент AI. Вы будете проектировать и эксплуатировать мульти-аккаунт окружение New Relic, строить кросс-аккаунт NRQL запросы, дашборды и конвейеры оповещений.

Упор на OpenTelemetry и Kinesis Firehose, Terraform и Crossplane. Кандидат с подтвержденным опытом работы в условиях сегрегации по технике/бизнессу и аудиту, способен организовать масштабируемую телеметрию и обеспечить надёжность

Qualifications

• 6+ лет опыта в наблюдаемости или SRE.
• Опыт эксплуатации New Relic как мульти-арендного консолидирующего слоя.
• Опыт агрегации и отчетности по телeметрике между аккаунтами/тенантами.

Responsibilities

• Проектирование и работа в мульти-аккаунтной среде наблюдаемости с New Relic.
• Создание cross-account NRQL запросов, дашбордов и отчетности.
• Реализация dashboards-as-code и alert-policy-as-code через Terraform и Crossplane.
• Настройка политик оповещений и маршрутизации в Opsgenie, подготовка к интеграции с ServiceNow.
• Поддержка телеметрии через OpenTelemetry/ADOT, OTLP и Kinesis Firehose.
• Определение масштабируемых размерностей метрик для крупных инстансов агентов.
• Автоматизация развёртывания и жизненного цикла наблюдательных ресурсов через Terraform и Crossplane.

Skills

Observability

SRE

New Relic

NRQL

Terraform

Crossplane

OpenTelemetry

Kinesis Firehose

Tools

New Relic

Terraform

Crossplane

OpenTelemetry

Kinesis Firehose

Job description

Описание:

The client is a large global enterprise operating across multiple markets, investing in modern cloud, data, and AI capabilities. The project is building an enterprise-grade AI Agent Platform to support the development, deployment, orchestration, security, and observability of AI agents across teams and use cases.

Задачи:

• Design and operate a multi-account New Relic observability environment, consolidating telemetry from multiple project tenants
• Build cross-account NRQL queries, dashboards, and reporting for centralized operational visibility
• Implement dashboards-as-code and alert-policy-as-code using Terraform and Crossplane
• Configure and manage New Relic alert policies and routing to Opsgenie, with future integration into ServiceNow
• Support telemetry ingestion into New Relic through OpenTelemetry/ADOT, OTLP, and Kinesis Firehose pipelines
• Define scalable metric dimensions and low-cardinality facets for large AI agent estates
• Establish observability patterns for Technical, Business, and Audit telemetry segregation
• Support cross-tenant monitoring, reporting, and operational governance
• Collaborate on observability for GenAI workloads, including AWS Bedrock AgentCore telemetry and cost/token attribution
• Automate provisioning and lifecycle management of observability resources using Terraform and Crossplane

Требования:

• 6+ Years of observability or SRE engineering experience
• Experience operating New Relic or equivalent SaaS observability as a multi-tenant consolidation layer
• Experience with cross-account/cross-tenant telemetry aggregation and reporting
• Experience working within a Technical/Business/Audit observability segregation model
• New Relic administration at scale, including management account and cross-account setup
• NRQL cross-account queries aggregating telemetry from multiple project tenants
• Dashboards-as-code and alert-policy-as-code using the Terraform New Relic provider and Crossplane
• New Relic alert policies routed to Opsgenie
• OpenTelemetry/ADOT fundamentals, including OTLP and Firehose ingestion into New Relic
• Metric dimension design for large agent estates using stable, low-cardinality facets
• Будет плюсом: AWS Bedrock AgentCore observability (Transaction Search, GenAI Observability), Kinesis Firehose metric/log forwarding pipelines (CloudWatch New Relic), cost/token attribution modeling for GenAI workloads, Crossplane-based provisioning of observability resources

Условия:

• Benefits supporting well-being and professional growth