Remote Senior AI Engineer – Observability & AI/ML

Far Coder; United States; Hybrid; USD 93,000 - 156,000; Full time

Job summary

Grafana Labs is hiring a remote Senior AI Engineer to join Grafana AI/ML, with work location in the USA and remote options. The role focuses on building AI-powered features for observability and incident response, leveraging Kubernetes, Terraform, Rust, and major cloud platforms.

We value rapid iteration, ownership, and collaboration across product, data, and design teams. The position offers a global, fully remote environment with generous leave and a strong emphasis on Open Source roots and a

Qualifications

• Experience with LLMs and prompt engineering in production systems.
• Experience delivering software in cloud environments (AWS, GCP, Azure).
• Experience with observability tooling and incident response.

Responsibilities

• Build and deliver AI solutions: Take ownership of developing high-performance AI features to help users detect, triage, and resolve incidents using observability data and tools.
• Rapid experimentation and iteration: Implement a highly iterative process where you quickly prototype, test, and validate with real users, including shipping and evolving LLM- or agent-powered workflows for incident lifecycle management and automated analysis tasks.
• Collaborate cross-functionally: Work with data analysts, product managers, and designers to shape AI-driven product features, including integration of agentic components with internal tools, alerting systems, runbooks, and developer workflows.
• Utilize AI tools effectively: Use AI and automation tools to enhance both product functionality and your own development workflows.
• Effective communication: You’ll be working in a highly dynamic and collaborative environment, so we need someone who can communicate effectively and contribute across teams.
• Ownership and impact: Take full ownership of the AI solutions you develop, ensuring they are scalable, maintainable, and aligned with real user workflows.

Skills

LLMs

Prompt engineering

Cloud-native engineering

Observability tooling

Tools

Kubernetes

Terraform

Rust

AWS

GCP

Azure

Job description

Grafana Labs is hiring a remote Senior AI Engineer to join Grafana AI/ML, with work location in the USA and remote options. The role focuses on building AI-powered features for observability and incident response, leveraging Kubernetes, Terraform, Rust, and major cloud platforms.

We value rapid iteration, ownership, and collaboration across product, data, and design teams. The position offers a global, fully remote environment with generous leave and a strong emphasis on Open Source roots and a