Lead AI-Driven Observability Engineer

Allstate Foundation; Illinois; Remote; USD 100,000 - 171,000; Full time

Benefits offered by this job

Connectivity reimbursement

Company equipment for home setup

Laptop, monitors, headset provided

Job summary

Allstate Insurance is seeking a forward-thinking Lead Product Engineer to drive AI-powered observability in a hybrid, multi-cloud environment. You will design autonomous AI agents, embed AI capabilities in observability platforms, and lead the development of scalable, reusable platform components and APIs.

This role focuses on automation, proactive insights, and self-healing systems to improve reliability and performance.

Qualifications

• 5+ years engineering experience building software, platforms, or automation solutions.
• 4+ years hands-on experience with observability platforms (Datadog, Dynatrace, OTEL).
• 3+ years software development experience using Java/Spring Boot, Python, Node.js, or React.
• 2+ years hands-on experience building agentic AI systems (autonomous agents, AI workflows, or AI-native applications).
• Proven ability to design and implement AI-driven automation and AIOps solutions.

Responsibilities

• Design and build agentic AI solutions for observability including autonomous agents for anomaly detection and remediation.
• Embed AI/ML into observability platforms to enable predictive insights and intelligent alerting.
• Develop AIOps frameworks that reduce noise and automate workflows and incident responses.
• Leverage LLMs and AI orchestration frameworks to create self-service diagnostics and operational assistants.
• Architect end-to-end observability across logs, metrics, traces, and events.
• Enhance platforms with custom integrations, automation, and AI enhancements.
• Build real-time insights and health analytics for reliability and performance.
• Lead development of scalable, reusable platform components and APIs for observability and automation.
• Create developer-first tools and frameworks to simplify instrumentation and diagnostics.
• Apply modern software practices including TDD, CI/CD, microservices, and cloud-native design.

Skills

Agentic AI

Observability platforms

Kubernetes

API development

Cloud-native architectures

Tools

Datadog

Dynatrace

OTEL

Job description

Allstate Insurance is seeking a forward-thinking Lead Product Engineer to drive AI-powered observability in a hybrid, multi-cloud environment. You will design autonomous AI agents, embed AI capabilities in observability platforms, and lead the development of scalable, reusable platform components and APIs.

This role focuses on automation, proactive insights, and self-healing systems to improve reliability and performance.