Senior Operational Engineer

Programming.com

Houston (TX)

On-site

USD 140,000 - 190,000

Full time

4 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Programming.com is seeking a Senior Operational Engineer to lead critical incident response and drive reliability across large-scale AI infrastructure. You will own incident management, collaborate with SRE, Infrastructure, Platform, Networking, and GPU Operations teams, and mentor engineers.

The ideal candidate has 6–10+ years in Infra Operations or SRE, strong hands-on Linux and networking skills, and experience with monitoring tools such as Grafana, PagerDuty, Jira, and ITSM platforms.

Qualifications

  • 6–10+ years of experience in Infra Operations, SRE, or Cloud Operations.
  • Hands-on Linux, networking, monitoring, and production troubleshooting.
  • Experience with Grafana, PagerDuty, Jira, ITSM platforms.
  • Proven ability to lead incidents, perform RCA, and improve reliability.
  • Knowledge of scripting, automation, APIs, and integrations.
  • Ability to independently lead operations and coordinate multiple teams.

Responsibilities

  • Lead high-severity production incidents, escalations, and Root Cause Analysis (RCA).
  • Troubleshoot complex Linux, cloud, networking, and infrastructure issues.
  • Own and optimize incident management, change management, and service-readiness processes.
  • Build and enhance monitoring dashboards, automation, and operational workflows.
  • Improve SLA/SLO performance, incident resolution times, and overall service reliability.
  • Collaborate with SRE, Infrastructure, Platform, Networking, and GPU Operations teams.
  • Mentor engineers and establish best practices for runbooks, on-call operations, and incident management.

Skills

Infrastructure Operations
SRE / Site Reliability Engineering
Troubleshooting
Incident leadership
Automation scripting
APIs & integrations

Tools

Grafana
PagerDuty
Jira
ITSM platforms

Job description

We're Hiring: Senior Operational Engineer – AI Infrastructure

Are you an experienced infrastructure engineer passionate about operational reliability, complex troubleshooting, and mission-critical AI infrastructure?

We're looking for a Senior Operational Engineer to lead critical incident response, improve infrastructure reliability, and drive operational excellence across large-scale AI infrastructure services.

What You'll Do
  • Lead high-severity production incidents, escalations, and Root Cause Analysis (RCA).
  • Troubleshoot complex Linux, cloud, networking, and infrastructure issues.
  • Own and optimize incident management, change management, and service-readiness processes.
  • Build and enhance monitoring dashboards, automation, and operational workflows.
  • Improve SLA/SLO performance, incident resolution times, and overall service reliability.
  • Collaborate with SRE, Infrastructure, Platform, Networking, and GPU Operations teams.
  • Mentor engineers and establish best practices for runbooks, on-call operations, and incident management.
What We're Looking For
  • 6–10+ years of experience in Infrastructure Operations, Site Reliability Engineering (SRE), Platform Engineering, or Cloud Operations.
  • Strong hands-on experience with Linux, networking, monitoring, and production troubleshooting.
  • Experience with Grafana, PagerDuty, Jira, ITSM platforms, or equivalent tools.
  • Proven ability to lead critical incidents, conduct RCA, and implement reliability improvements.
  • Knowledge of scripting, automation, APIs, and operational integrations.
  • Ability to independently lead technical operations and coordinate multiple engineering teams.
Nice to Have
  • GPU cloud infrastructure and NVIDIA GPU monitoring.
  • High-Performance Computing (HPC) clusters.
  • Bare-metal servers and hardware diagnostics.
  • Experience supporting large-scale, 24/7 infrastructure environments.

#Hiring #InfrastructureEngineering #SRE #CloudOperations #AIInfrastructure #Linux #SiteReliabilityEngineering #DevOps #TechJobs

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior AI Infrastructure Reliability Engineer
Senior AI Infrastructure Reliability Engineer

Programming.com • Houston (TX)

On-site
USD 140,000 - 190,000
Infra Engineer - SRE(Kubernetes)
Infra Engineer - SRE(Kubernetes)

GMI Cloud • United States

On-site
USD 100,000 - 130,000
Operational Engineer
Operational Engineer

Nscale • New York (NY)

On-site
USD 90,000 - 130,000
Operational Engineer
Operational Engineer

Nscale • Houston (TX)

On-site
USD 110,000 - 150,000
Senior Solutions Engineer, AI Infrastructure
Senior Solutions Engineer, AI Infrastructure

VAST Data • New York (NY)

On-site
USD 150,000 - 200,000
Operational Engineer
Operational Engineer

Nscale • San Francisco (CA)

On-site
USD 110,000 - 170,000
Operational Engineer
Operational Engineer

Nscale • Seattle (WA)

On-site
USD 120,000 - 190,000
AI Infra Engineer – SRE (Kubernetes)
AI Infra Engineer – SRE (Kubernetes)

Berrybytes • United States

On-site
USD 110,000 - 150,000
Senior AI Infrastructure Engineer
Senior AI Infrastructure Engineer

EPAM Systems • United States

Remote
USD 140,000 - 190,000
Site Reliability Engineer
Site Reliability Engineer

Amiri Recruiting • Mountain View (CA)

On-site
USD 130,000 - 160,000