Senior Observability Platform Engineer – AI GPU Scale

Nscale; United States; On-site; USD 160,000 - 230,000; Full time

Benefits offered by this job

Medical, dental, vision insurance

Flexible paid time off (PTO)

Parental leave

Retirement plan

Job summary

Nscale is seeking a Senior Observability Platform Engineer to design, build, and scale our observability stack for GPU clusters and AI workloads. You’ll balance reliability, performance, and usability while shaping platform direction and collaborating with SRE, infrastructure, and AI/ML teams.

You’ll implement scalable data pipelines, improve signal quality, and mentor engineers. This hands-on role influences tooling, architecture, and postmortem improvements, delivering measurable reliability

Qualifications

• 5+ years in SRE, infra, platform, or observability roles.
• Experience operating and scaling observability in production.
• Strong monitoring concepts: metrics, logs, traces, alerting, and SLOs.
• Hands-on with Prometheus, Grafana, OpenTelemetry, etc.
• Programming in Python or Go for production systems.
• Kubernetes-based infrastructure experience.
• Infrastructure-as-Code with Terraform/Ansible.
• Pragmatic mindset focused on reliability and maintainability.
• Strong collaboration across teams.

Responsibilities

• Design, build, and operate scalable observability systems across metrics, logs, traces, and alerting
• Contribute to architectural decisions around tooling, data pipelines, storage, and retention strategies
• Improve signal quality by reducing noise, managing cardinality, and refining alerting practices
• Help identify and address observability gaps before they impact reliability
• Partner with SRE, infrastructure, and AI/ML teams to integrate observability into services and platforms
• Develop reusable patterns, libraries, and best practices across teams
• Participate in incident response and postmortems, driving actionable improvements
• Evaluate and adopt tools that improve developer experience, scalability, and operational efficiency
• Support and mentor engineers within the team through code reviews and knowledge sharing

Skills

SRE / Infra Eng

Observability

Programming: Python/Go

Kubernetes

IaC: Terraform/Ansible

Cross-team collaboration

Tools

Prometheus

Thanos

VictoriaMetrics

Grafana

Loki

Tempo

OpenTelemetry

ClickHouse

Elasticsearch/Elastic

Job description

Nscale is seeking a Senior Observability Platform Engineer to design, build, and scale our observability stack for GPU clusters and AI workloads. You’ll balance reliability, performance, and usability while shaping platform direction and collaborating with SRE, infrastructure, and AI/ML teams.

You’ll implement scalable data pipelines, improve signal quality, and mentor engineers. This hands-on role influences tooling, architecture, and postmortem improvements, delivering measurable reliability