Senior Site Reliability Engineer -AI Infrastructure Operations

Nscale

Houston (TX)

On-site

USD 170,000 - 265,000

Full time

30 hours ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Competitive base + equity
Ownership from start
Flexible schedule

Job summary

Nscale is seeking a senior SRE to set and raise the reliability bar across our AI-focused GPU cloud. You will own the hardest production problems, drive SLOs, build scalable tooling, and lead incidents to prevent recurrences while mentoring a growing SRE team.

You’ll work close to production, own design reviews, and shape how reliability is engineered into the platform, not bolted on after outages.

Qualifications

  • 6–10 years in SRE, systems engineering, or software engineering with production ownership at scale.
  • Strong software engineering skills (Python, Go, or similar) and tooling adopted by peers.
  • Deep command of Linux, networking, and distributed systems.
  • Hands-on with Kubernetes and virtualized or bare-metal environments.
  • Experience running AI or GPU workloads or HPC with rapid learning curve.
  • Reliability practices: SLOs, observability, alerts, incident processes.
  • Senior voice in incidents and design reviews, able to decide under pressure.
  • A habit of raising the people around you.

Responsibilities

  • Own reliability for critical production services end to end and set direction.
  • Grow the team, mentor SREs through reviews, pairing, and debriefs; raise the bar.
  • Define and implement the SLO framework and incident processes for sustainability.
  • Involve early in design reviews to bake reliability in from the start.
  • Lead the most challenging incidents and root-cause analysis to prevent recurrences.
  • Build tooling and automation to remove toil across the team.

Skills

SRE Experience
Python
Go
Linux
Networking
Distributed systems
Kubernetes
GPU workloads
On-call / incident mgmt
Mentoring / leadership

Job description

About Nscale

Nscale is the GPU cloud built for AI. We run high-performance, cost-efficient infrastructure for AI-native startups and global enterprises, from bare metal up through the platform services teams actually build on. Our culture runs on ownership, accountability, and speed. We move with urgency, we tell each other the truth, and everyone here stays close to the infrastructure that makes AI work.

The Role

This is a senior SRE role for someone who sets the reliability bar and then pulls the rest of the team up to it. You'll own the hardest problems on the platform: the automation other engineers build on, the services that can't go down, and the design decisions that determine whether either holds up at scale. You'll still carry a pager, but the real job is making sure it fires less, for everyone, over time.

What You'll Do
  • Own reliability for critical production services end to end; set the direction, not just respond to what breaks.
  • Grow the team, not just the systems; mentor other SREs through design review, pairing, incident debriefs, and hold the bar that pulls everyone up to it.
  • Set the standards the rest of the team works to: the SLO framework, the incident process, and the on-call practices that keep it sustainable.
  • Get in early on design reviews and architecture decisions, so reliability is built in rather than bolted on after the first outage.
  • Lead the hardest incidents and the root causes nobody else can crack; turn each one into a change that keeps it from coming back.
  • Build the tooling and automation that removes toil for the whole team, not just your own surface area.
What You'll Bring
  • 6-10 years in SRE, systems engineering, or software engineering, with real ownership of production at scale in a data center or cloud environment.
  • Strong software engineering skills (Python, Go, or similar); you build tools other engineers adopt, not scripts that run once and rot.
  • Deep command of Linux, networking, and distributed systems, plus the judgment to know where the real failure modes hide.
  • Hands-on with Kubernetes and virtualized or bare-metal environments; comfortable close to the metal, not just the cloud console.
  • Experience running AI or GPU workloads, or high-performance computing (HPC); if not, the depth to get there fast.
  • Reliability practices you put in place that outlasted you: SLOs, observability and alerting at scale, incident process, on-call that people can actually live with.
  • A track record as the senior voice in incidents and design reviews, trusted to make the call under pressure.
  • A habit of raising the people around you without being asked to.
Nice to Have
  • Familiarity with high-performance networking (InfiniBand, RDMA).
On-Call and Pace

A quick note on the shape of the job. This role sits close to production, so there is an on-call rotation, and some weeks are busier than others. As a senior on the team, you help set how that rotation runs and, more to the point, how we make it lighter over time. We share the load fairly, and we treat every page as a signal worth acting on rather than just an interruption. The goal is to leave the systems quieter than you found them, so each rotation asks less of the person carrying it. If that's the kind of ownership you're drawn to, you'll do well here.

What We Offer
  • Competitive base plus equity, reviewed every 12 months.
  • Real ownership from the start, and a direct hand in how reliability works across the platform.
  • Flexibility that treats you as an adult; we care that the work gets done, and we trust you to shape your day.
Salary Range

$170,000 - $265,000 USD. Actual compensation varies with skill set, experience, and location, and the role may be eligible for bonus and equity.

Equal Opportunities Statement

At Nscale, we are committed to fostering an inclusive, diverse, and equitable workplace. We believe that a variety of perspectives enrich our work environment, and we encourage applications from candidates of all backgrounds, experiences, and abilities. We strongly encourage applications from people of colour, the LGBTQ+ community, people with disabilities, neurodivergent people, parents, carers, and people from lower socio-economic backgrounds.

If there’s anything we can do to accommodate your specific situation, please let us know.

Salary Range

The range below reflects the base salary for the position. Actual compensation may vary based on job-related factors such as skill set, experience, education, and location. In addition to base salary, this role may be eligible for bonus, equity, and/or commission programs. Nscale may offer a competitive benefits package including medical, dental, vision, flexible paid time off, parental leave, and retirement plan participation.

Salary Range: $170,000 USD - $265,000 USD

For information on how Nscale handles candidate personal data, please see our Employee & Candidate Privacy Notice: Here. Nscale does not accept unsolicited candidate submissions from recruitment agencies.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Staff Cloud Native Software Engineer
Staff Cloud Native Software Engineer

Nscale • Seattle (WA)

On-site
USD 220,000 - 265,000
Medical, dental, vision
Flexible paid time off
Parental leave
+1
Senior Engineer, Storage Services
Senior Engineer, Storage Services

Nscale • New York (NY), San Francisco (CA), Seattle (WA)

On-site
USD 120,000 - 190,000
Flexible workplace
Competitive compensation
Medical, dental, vision
+3
Sr. Staff Security Engineer, Platform Security
Sr. Staff Security Engineer, Platform Security

Nscale • United States

Remote
USD 210,000 - 250,000
Base salary + bonus + equity
Equity options
Flexible work environment
+2
Staff Security Engineer, Network Security
Staff Security Engineer, Network Security

Nscale • United States

Remote
USD 160,000 - 190,000
Equity
Flexible work arrangements
Medical benefits
+1
Senior Director, System Engineering & Intelligence, Global
Senior Director, System Engineering & Intelligence, Global

Nscale • United States

Remote
USD 280,000 - 400,000
Remote-first team
Equity and bonus programs
Medical, dental, vision, PTO, parental
Director, DC Operations (West Virginia)
Director, DC Operations (West Virginia)

Nscale • Wheeling (WV)

On-site
USD 200,000 - 270,000
Equity
Remote-first team
Flexible paid time off
+1
Director, DC Operations (West Virginia)
Director, DC Operations (West Virginia)

Nscale • United States

On-site
USD 200,000 - 270,000
Principal Technical Program Manager, AI Physical Deployment
Principal Technical Program Manager, AI Physical Deployment

Nscale • Seattle (WA)

Hybrid
USD 250,000 - 303,000
Base + equity
Flexible work arrangements
Career growth plan
+1
Senior Director, System Engineering & Intelligence, Global
Senior Director, System Engineering & Intelligence, Global

Nscale • Seattle (WA)

Remote
USD 280,000 - 400,000
Base salary + equity
Remote-first team
Flexible PTO
+1
Staff Security Engineer, Network Security
Staff Security Engineer, Network Security

Nscale • New York (NY), San Francisco (CA), Seattle (WA)

On-site
USD 160,000 - 190,000
Bonus
Equity
Medical benefits
+1