Senior Observability Platform Engineer for AI GPU Cloud

Nscale

United States

Hybrid

USD 160,000 - 230,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Medical
Dental
Vision
Flexible PTO
Parental Leave
Retirement Plan

Job summary

Nscale is hiring a Senior Observability Platform Engineer to design, build, and scale our observability stack for GPU-driven AI workloads. You’ll partner with SRE, infra, and AI/ML teams to deliver reliable visibility across clusters and workloads, balancing usability, reliability, and performance.

This hands-on role involves creating reusable patterns, contributing to platform direction, and mentoring engineers while embedding observability into every service we run.

Qualifications

  • 5+ years in SRE, infrastructure engineering or observability roles.
  • Experience operating observability systems in production environments.
  • Strong monitoring concepts and production reliability focus.

Responsibilities

  • Design, build, and operate scalable observability systems across metrics, logs, traces, and alerting.
  • Collaborate with SRE, infra, and AI/ML teams to embed observability into services.
  • Improve signal quality, reduce noise, and refine alerting practices.
  • Address observability gaps before impact, and drive postmortems improvements.
  • Develop reusable patterns and best practices for teams to follow.
  • Participate in incident response and remediation actions.
  • Evaluate tools to improve developer experience and scalability.
  • Mentor engineers through code reviews and knowledge sharing.

Skills

SRE Experience
Production systems
Collaboration
Observability concepts
Python
Go

Tools

Prometheus
Thanos
VictoriaMetrics
Grafana
Loki
Tempo
OpenTelemetry
ClickHouse
Elastic
Kubernetes
Terraform
Ansible

Job description

Senior Observability Platform Engineer – Nscale

About Nscale

Nscale is the GPU cloud engineered for AI. We provide cost-effective, high-performance infrastructure for AI start-ups and large enterprise customers. Nscale simplifies AI development while enabling superior results, supporting strategic business outcomes such as cost management, rapid innovation, and environmental responsibility.

We thrive on a culture of relentless innovation, ownership, and accountability, where every team member takes pride in their work and drives it with excellence and urgency. As an Nscaler, you’ll build trust through openness and transparency while contributing to the technology that powers the future.

About the Role

As a Senior Observability Platform Engineer, you’ll play a key role in designing, building, and scaling Nscale’s observability platform. You’ll focus on delivering reliable, high-quality visibility into GPU clusters, AI workloads, and the infrastructure that powers them.

You approach observability as a product—balancing usability, scalability, and operational efficiency. You build systems that reduce cognitive load for engineers, surface meaningful signals, and enable fast, confident debugging when things go wrong.

You’ll contribute to platform direction, implement critical systems, and collaborate closely with SRE, infrastructure, and AI/ML teams to ensure observability is embedded into everything we run.

This is a hands-on engineering role with meaningful influence over platform design and evolution.

What You’ll Do
  • Design, build, and operate scalable observability systems across metrics, logs, traces, and alerting
  • Contribute to architectural decisions around tooling, data pipelines, storage, and retention strategies
  • Improve signal quality by reducing noise, managing cardinality, and refining alerting practices
  • Help identify and address observability gaps before they impact reliability
  • Partner with SRE, infrastructure, and AI/ML teams to integrate observability into services and platforms
  • Develop reusable patterns, libraries, and best practices that improve consistency across teams
  • Participate in incident response and postmortems, driving actionable improvements
  • Evaluate and adopt tools that improve developer experience, scalability, and operational efficiency
  • Support and mentor engineers within the team through code reviews and knowledge sharing
About You
  • 5+ years in SRE, infrastructure engineering, platform engineering, or observability-focused roles
  • Experience operating and scaling observability systems in production environments
  • Strong understanding of monitoring concepts: metrics, logs, traces, alerting, and SLOs
  • Hands-on experience with several of: Prometheus, Thanos, VictoriaMetrics, Grafana, Loki, Tempo, OpenTelemetry, ClickHouse, Elastic
  • Solid programming skills (Python, Go, or similar) with the ability to build and maintain production systems
  • Experience working with Kubernetes-based infrastructure
  • Familiarity with Infrastructure-as-Code (Terraform, Ansible, or similar)
  • Pragmatic mindset with a focus on simplicity, reliability, and maintainability
  • Strong collaboration skills and ability to work across teams
Preferred
  • Experience with observability data pipelines (Kafka, Vector, Fluent Bit, etc.)
  • Exposure to AI/ML infrastructure or GPU-based systems
  • Familiarity with performance monitoring for distributed systems
  • Experience improving developer experience through observability tooling

We strongly encourage applications from people of color, the LGBTQ+ community, people with disabilities, neurodivergent individuals, parents, carers, and people from lower socio-economic backgrounds.

If there’s anything we can do to accommodate your specific situation, please let us know.

Note: Responsibilities outlined are not exhaustive and may evolve as business needs change

The range below reflects the base salary for the position. Actual compensation may vary based on job-related factors such as skill set, experience, education, and location. In addition to base salary, this role may be eligible for bonus, equity, and/or commission programs. Nscale may offer a competitive benefits package including medical, dental, vision, flexible paid time off, parental leave, and retirement plan participation.

Salary Range

$160,000 - $230,000 USD

For information on how Nscale handles candidate personal data, please see our Employee & Candidate Privacy Notice: Here.

Nscale does not accept unsolicited candidate submissions from recruitment agencies.

Apply for this job

*

indicates a required field

First Name *

Last Name *

Email *

Phone

Country *

Phone *

Location (City) *

Resume/CV *

Enter manually

Accepted file types: pdf, doc, docx, txt, rtf

Enter manually

Accepted file types: pdf, doc, docx, txt, rtf

LinkedIn Profile

Website

What is your current or most recent employer? *

What is your preferred name? *

Are you currently legally authorized to work in the country where this role is based? * Select...

Will you now or in the future require Nscale to sponsor or support an immigration application for you to be authorized to work in the role's country? * Select...

Nscale uses AI-powered tools to assist in reviewing and prioritising applications against the requirements of this role. All final hiring decisions are made by humans. To learn more about how AI is used and your rights, click "Learn more" below.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Staff Cloud-Native Engineer for AI Infrastructure
Staff Cloud-Native Engineer for AI Infrastructure

Nscale • Houston (TX)

Hybrid
USD 220,000 - 265,000
Medical benefits
Dental benefits
Flexible PTO
Senior Technical Recruiter for AI Infrastructure & Cloud
Senior Technical Recruiter for AI Infrastructure & Cloud

Nscale • San Francisco (CA)

On-site
USD 160,000 - 210,000
Medical, dental, vision
Flexible PTO
Parental leave
+1
Senior SRE – AI Infrastructure & Reliability Leader
Senior SRE – AI Infrastructure & Reliability Leader

Nscale • Houston (TX), San Francisco (CA), Seattle (WA)

On-site
USD 170,000 - 265,000
Competitive base + equity
Ownership from start
Flexible work day
Senior AI Cluster Performance & Validation Engineer
Senior AI Cluster Performance & Validation Engineer

Nscale • Houston (TX), New York (NY), San Francisco (CA), Seattle (WA)

On-site
USD 180,000 - 240,000
Staff AI Platform Engineer — Inference & Scale Leader
Staff AI Platform Engineer — Inference & Scale Leader

Nscale • New York (NY)

Hybrid
USD 220,000 - 330,000
Senior Storage Services Architect
Senior Storage Services Architect

Nscale • Houston (TX), New York (NY), San Francisco (CA), Seattle (WA)

Remote
USD 120,000 - 190,000
Flexible workplace
Competitive compensation
Medical, dental, vision
+3
Technical Program Manager, Global TechOps Delivery
Technical Program Manager, Global TechOps Delivery

Nscale • United States

Hybrid
USD 180,000 - 210,000
Equity
Bonus
Medical insurance
+3
Global AI Media Relations Director
Global AI Media Relations Director

Nscale • San Francisco (CA)

Hybrid
USD 170,000 - 300,000
Bonus program
Equity opportunities
Comprehensive benefits
Senior Security Assurance Lead — SOC 2 & ISO 27001
Senior Security Assurance Lead — SOC 2 & ISO 27001

Nscale • New York (NY)

Hybrid
USD 140,000 - 180,000
Equity
Bonus program
Flexible work options
AI Infra TPM: Scale, Availability & Ops Leadership
AI Infra TPM: Scale, Availability & Ops Leadership

Nscale • New York (NY)

Hybrid
USD 150,000 - 230,000