Senior Network Observability Engineer

St Jude Children's Research Hospital; Memphis (TN); On-site; USD 95,000 - 170,000; Full time

Job summary

St Jude Children's Research Hospital in Memphis is seeking a Senior Network Observability Engineer to own visibility into network health, performance, and availability across a large, multi-site environment.

You will design observability pipelines, build dashboards, and lead root cause analysis to prevent outages affecting patients, staff, or research systems. A strong background in SNMP, NetFlow, and telemetry is required, with CCNP preferred.

Qualifications

• Four years of IT experience in infrastructure operations and engineering environments.
• Experience in infrastructure design, systems analysis, and security management.
• Some experience with commercial models around infrastructure capacity procurement.
• Experience in customer service and vendor management.
• Experience in business stakeholder engagement and management.
• Hands-on experience with at least one observability tool such as StatSeeker, ThousandEyes, SolarWinds, or similar.
• Familiarity with SNMP, NetFlow/IPFIX, streaming telemetry, and syslog architectures.

Responsibilities

• Design and maintain observability pipelines across StatSeeker, ThousandEyes, Cisco Catalyst Center, and NDFC.
• Build dashboards and alerting that surface SLA breaches, capacity trends, and anomalies across the network.
• Correlate telemetry across the network stack into a single operational picture.
• Integrate monitoring data into ServiceNow for auto-ticketing and queue visibility.
• Route and process telemetry events using Azure Event Grid to support real-time alerting and downstream integrations.
• Develop synthetic monitoring and active testing for key network paths and services.
• Lead root cause analysis on major incidents using historical telemetry and trend data.
• Establish baselines and thresholds for network performance across sites and platforms.
• Document observability standards and mentor the team on interpreting and acting on data.

Skills

IT infrastructure experience

Vendor management

Stakeholder engagement

Customer service

Root cause analysis

Education

Bachelor's degree in Computer Science, Engineering, Business or related field

Master's degree preferred

Tools

StatSeeker

ThousandEyes

SolarWinds

LogicMonitor

ServiceNow

Job description

The Enterprise Network Team is building out proactive observability across a large, multi-site network. This role owns visibility into network health, performance, and availability, turning raw telemetry into actionable insight before problems hit patients, staff, or research systems.

Job Responsibilities:

• Design and maintain observability pipelines across StatSeeker, ThousandEyes, Cisco Catalyst Center, and NDFC.
• Build dashboards and alerting that surface SLA breaches, capacity trends, and anomalies across the network.
• Correlate telemetry across the network stack (Catalyst, Nexus, F5, ISE, BlueCat) into a single operational picture.
• Integrate monitoring data into ServiceNow for auto-ticketing and queue visibility.
• Route and process telemetry events using Azure Event Grid to support real-time alerting and downstream integrations.
• Develop synthetic monitoring and active testing for key network paths and services.
• Lead root cause analysis on major incidents using historical telemetry and trend data.
• Establish baselines and thresholds for network performance across sites and platforms.
• Document observability standards and mentor the team on interpreting and acting on data.
• Perform other duties as assigned to meet the goals and objectives of the department and institution.
• Maintains regular and predictable attendance.

Minimum Education and/or Training:

• Bachelor's degree in Computer Science, Engineering, Business or related field of study required.
• Master's degree preferred.

Minimum Experience:

• Minimum experience: Four (4) years of IT experience with experience in infrastructure operations and engineering environments.
• Experience in infrastructure design, systems analysis, and security management.
• Some experience working with commercial models around infrastructure capacity procurement.
• Experience in customer service and vendor management.
• Some experience in business stakeholder engagement and management.
• Hands-on experience with at least one of StatSeeker, ThousandEyes, SolarWinds, LogicMonitor, or similar preferred.
• Strong understanding of SNMP, NetFlow/IPFIX, streaming telemetry, and syslog architectures preferred.
• Experience with Azure Event Grid or similar event routing/messaging services preferred.Deep understanding of Cisco routing/switching, with comfort working across Catalyst, Nexus, and NDFC environments preferred.
• Experience integrating network systems with ITSM platforms like ServiceNow preferred.
• Familiarity with healthcare or other high-availability environments preferred.
• CCNP or equivalent certification preferred.
• Proven performance in earlier role/comparable role.

Compensation

In recognition of certain U.S. state and municipal pay transparency laws, St. Jude is including a reasonable estimate of the compensation range for this role. This is an estimate offered in good faith and a specific salary offer takes into account factors that are considered in making compensation decisions including but not limited to skill sets, experience and training, licensure and certifications, and other business and organizational needs. It is not typical for an individual to be hired at or near the top of the salary range and compensation decisions are dependent on the facts and circumstances of each case. A reasonable estimate of the current salary range is $94,640 - $169,520 per year for the role of Senior Network Observability Engineer.

Explore our exceptional benefits !

St. Jude is an Equal Opportunity Employer

No Search Firms

St. Jude Children's Research Hospital does not accept unsolicited assistance from search firms for employment opportunities. Please do not call or email. All resumes submitted by search firms to any employee or other representative at St. Jude via email, the internet or in any form and/or method without a valid written search agreement in place and approved by HR will result in no fee being paid in the event the candidate is hired by St. Jude.