Site Reliability Engineer

HTC Global Services; Charlotte (NC); On-site; USD 120,000 - 160,000; Full time

Benefits offered by this job

Health, Dental, Vision

401(k) matching

Paid Time Off

Professional Development

Wellness programs

Job summary

HTC Global Services is migrating from Moogsoft to PagerDuty, redesigning incident workflows and integrating monitoring tools for live production visibility. You will implement event orchestration, deduplication rules, and alert suppression to reduce alert fatigue while building automated incident response and on-call processes.

You will collaborate with engineering teams, create runbooks, and train staff on PagerDuty best practices, aiming for a zero-downtime transition and a scalable incident

Qualifications

• Deep hands-on experience with PagerDuty including architectural design and event routing.
• Familiarity with Moogsoft (clustering, Situation Room, ingestion logic).
• Strong understanding of how monitoring tools feed into incident management platforms.
• Experience with observability tools like Datadog, New Relic, Splunk, AWS CloudWatch.
• Proficiency in Python, Bash, or Go for PagerDuty API integrations.

Responsibilities

• Lead migration from Moogsoft to PagerDuty as primary incident tool.
• Connect Datadog, New Relic, Splunk, and AWS CloudWatch to PagerDuty.
• Configure Event Orchestration, deduplication, and alert suppression.
• Build automated incident response workflows, on-call schedules, escalation policies, and ChatOps integrations.
• Create runbooks and train teams on PagerDuty best practices.

Skills

PagerDuty

Moogsoft

Datadog

New Relic

Splunk

AWS CloudWatch

Python

Bash

Go

Terraform

Tools

PagerDuty

Moogsoft

Datadog

New Relic

Splunk

AWS CloudWatch

Terraform

Job description

Job Description

Senior Site Reliability Engineer (SRE) – PagerDuty / Moogsoft Migration

Position Overview

Lead a critical observability and incident-management transformation by migrating from the legacy Moogsoft AIOps platform to PagerDuty. This role focuses on redesigning incident management workflows, implementing event orchestration, integrating monitoring platforms, and enabling a seamless transition to PagerDuty for live production monitoring.

What You'll Do / Key Responsibilities

• Lead the migration from Moogsoft and implement PagerDuty as the primary incident intelligence and alerting platform.
• Connect existing monitoring tools, including Datadog, New Relic, Splunk, and AWS CloudWatch, directly into PagerDuty.
• Configure PagerDuty Event Orchestration, deduplication rules, and alert suppression to minimize alert fatigue.
• Build automated incident response workflows, on-call schedules, escalation policies, and bidirectional ChatOps integrations with Slack and Teams.
• Create runbooks for the new system.
• Train engineering teams on PagerDuty best practices.
• Support a seamless transition with zero downtime to live production monitoring.

Required Qualifications

• Deep, hands-on experience with PagerDuty, including architectural design, event routing, and advanced configurations.
• Familiarity with Moogsoft, including clustering, Situation Room, and ingestion logic.
• Strong understanding of how monitoring tools feed into incident management platforms.
• Experience working with observability/monitoring tools such as Datadog, New Relic, Splunk, and AWS CloudWatch.
• Proficiency in Python, Bash, or Go for utilizing PagerDuty APIs and developing custom integrations.

Preferred Qualifications

• Experience managing PagerDuty configurations using Terraform / Infrastructure as Code (IaC).

What Makes HTC A Great Place To Build Your Future

HTC Global Services wants you to join our team. Come build new things with us and advance your career. At HTC Global, you’ll collaborate with experts, work alongside clients, and be part of high-performing teams driving success together. You’ll have long-term opportunities to grow your career and develop skills in the latest emerging technologies.

At HTC Global Services, our employees have access to a comprehensive benefits package. Benefits can include Group Health (Medical, Dental, and Vision), Paid Time Off, Paid Holidays, 401(k) matching, Group Life and Disability insurance, Professional Development opportunities, Wellness programs, and a variety of other perks.

Our success as a company is built on inclusion and diversity. HTC Global Services is committed to providing a workplace free from discrimination and harassment, where every employee is treated with dignity and respect. We celebrate differences and believe that diverse cultures, perspectives, and skills drive innovation and success. HTC is an Equal Opportunity Employer and a proud National Minority Supplier. We seek to empower each individual, fostering an environment where everyone feels valued, included, and respected.

#SRE #SiteReliabilityEngineer #DevOps #DevOpsEngineer #PagerDuty #Moogsoft #AIOps