Senior Observability Platform Engineer

Together AI; San Francisco (CA); Hybrid; USD 200,000 - 280,000; Full time

Job summary

Together AI is building the AI Acceleration Cloud, an end-to-end platform for the full generative AI lifecycle, combining the fastest LLM inference engine with state-of-the-art AI cloud infrastructure.

The storage and observability team is responsible for designing, implementing, and maintaining robust distributed storage solutions and comprehensive observability platforms, providing critical insights into system performance and GPU utilization, and proactively resolving issues.

Qualifications

• Experience with observability platforms and cloud-native monitoring services across AWS, GCP, and Azure.
• Proficient in Go or Python and infrastructure-as-code tools like Terraform, Ansible, and Helm.
• Proven ability to design, operate, and scale large distributed systems and data pipelines.

Responsibilities

• Design and implement a scalable observability platform (metrics, logs, traces) using Prometheus, Grafana, ClickHouse/ClickStack, and OpenTelemetry, with telemetry pipelines and log aggregation.
• Develop automated monitoring, alerting, and anomaly detection systems, including SLIs/SLOs, runbooks, and predictive analytics for critical services.
• Build and deploy custom observability tools and infrastructure-as-code using Go, Python, Terraform, Ansible, and Helm.
• Collaborate with engineering teams to enhance distributed tracing and application monitoring, and lead incident response with post-mortem analysis.
• Define observability best practices.

Skills

Observability platforms

Go

Python

Cloud-native monitoring

CI/CD & GitOps

Distributed systems

Tools

Prometheus

Grafana

ClickStack

OpenTelemetry

AWS

GCP

Azure

Terraform

Ansible

Helm

Docker

Kubernetes

PostgreSQL

MongoDB

Redis

Job description

Together AI is building the AI Acceleration Cloud, an end-to-end platform for the full generative AI lifecycle, combining the fastest LLM inference engine with state-of-the-art AI cloud infrastructure.

The storage and observability team is responsible for designing, implementing, and maintaining robust distributed storage solutions and comprehensive observability platforms, providing critical insights into system performance and GPU utilization, and proactively resolving issues.