Senior AI Engineer - Observability & AI Agents (Remote)

Grafanalabs; United States; Remote; USD 91,000 - 153,000; Full time

Job summary

Grafana Labs is seeking a Senior AI Software Engineer to build AI-powered observability features and agent-driven workflows. You will ship production-grade AI solutions that improve incident response and infrastructure insights, with an emphasis on rapid experimentation and autonomy.

You’ll work closely with data scientists, product managers, and designers in a highly collaborative, cloud-native environment, prioritizing scalability, reliability, and performance while expanding the capabilities

Qualifications

• Experience with LLMs, prompt engineering, and GenAI-powered applications.
• Proven track record delivering production software used by users.
• Experience in cloud-native environments (AWS, GCP, Azure).
• Familiarity with observability tooling to troubleshoot behavior.

Responsibilities

• Build and deliver AI features to detect, triage, and resolve incidents using observability data.
• Prototype and ship agent-powered workflows for incident lifecycle management.
• Collaborate with data analysts, product managers, and designers.
• Own AI solutions, ensuring scalability and maintainability.

Skills

Backend dev

AI/GenAI

LLMs

Cloud platforms

Observability

Full-stack

Team collaboration

Tools

Kubernetes

Docker

Terraform

OpenAI

Anthropic

GCP

Job description

Grafana Labs is seeking a Senior AI Software Engineer to build AI-powered observability features and agent-driven workflows. You will ship production-grade AI solutions that improve incident response and infrastructure insights, with an emphasis on rapid experimentation and autonomy.

You’ll work closely with data scientists, product managers, and designers in a highly collaborative, cloud-native environment, prioritizing scalability, reliability, and performance while expanding the capabilities