AI Incident Response Engineer (Technical Lead)

Meta; Menlo Park (CA); On-site; USD 219,000 - 301,000; Full time

Benefits offered by this job

Bonus

Equity

Benefits

Job summary

Meta is seeking a Software Engineer, AI for Incident Response (Technical Leadership) in Menlo Park to shape the technical direction of an AI-powered incident investigation and mitigation agent. You will design and ship core capabilities, improve root-cause detection, and build evaluative systems that learn from production outcomes, with human oversight and secure, auditable workflows.

The role spans large-scale distributed systems, applied AI, and reliability engineering, collaborating with

Qualifications

• 10+ years of software engineering experience, including experience building and operating large-scale distributed, infrastructure, or production AI systems.
• Experience setting technical direction and leading complex engineering efforts across multiple teams or organizational boundaries.
• Experience applying AI to production problems at scale, including evaluation of system quality and failure modes.
• Recent hands-on experience designing, coding, debugging, and shipping complex production systems.
• Experience building systems that support critical, always-on production workloads.
• Experience diagnosing complex production systems using telemetry, code, configuration, deployments, and dependency information.
• Experience coding in languages such as C++, Java, Python, Rust, or equivalent.
• Experience influencing senior engineers and leaders without direct organizational authority.

Responsibilities

• Define and drive the technical vision, architecture, and execution roadmap for AI-powered incident investigation and mitigation.
• Personally design, code, evaluate, and ship major capabilities in a production agentic system.
• Improve timely root-cause accuracy through better reasoning, skills, tool use, context, memory, planning, and domain knowledge.
• Build the offline evaluation, historical replay, and online experimentation systems needed to measure changes and continuously improve agent behavior.
• Create a transparent, multi-turn experience that supports collaborative investigation with expert responders and agent-led guidance for less frequent responders.
• Enable the agent to reason across telemetry, code, configuration, deployments, service dependencies, operational knowledge, and incident history.
• Build closed-loop learning systems that turn production outcomes and user feedback into evaluations, experiments, and product improvements.
• Advance the system toward progressive autonomy with explicit authorization, validation, auditability, rollback, and human oversight.
• Build an extensible platform that combines shared capabilities with domain-specific skills, tools, and agents contributed by infrastructure and product teams.
• Partner closely with on-call engineers, reliability experts, product groups, data science, and product management to drive accuracy, adoption, and realized operational impact.
• Ensure the system meets a high bar for reliability, latency, scale, security, privacy, and cost.
• Influence technical strategy across organizations and mentor senior engineers working across distributed systems and applied AI

Skills

Technical leadership

Production AI

Distributed systems

Production debugging

C++/Java/Python/Rust

Incident response

Telemetry & Deployments

Stakeholder influence

Job description

Meta is seeking a Software Engineer, AI for Incident Response (Technical Leadership) in Menlo Park to shape the technical direction of an AI-powered incident investigation and mitigation agent. You will design and ship core capabilities, improve root-cause detection, and build evaluative systems that learn from production outcomes, with human oversight and secure, auditable workflows.

The role spans large-scale distributed systems, applied AI, and reliability engineering, collaborating with