Principal AI Reliability Engineer — Autonomous Incident Agent

Meta; Carson City (NV); On-site; USD 271,000 - 347,000; Full time

Job summary

Meta seeks an experienced Software Engineer to build the next generation of AI systems for production reliability and to lead the development of autonomous AI agents for incident investigation and mitigation at scale.

You will prototype, evaluate, and ship AI-enabled infrastructure solutions, working hands-on with production data and code, all under senior leadership supervision to ensure safety and reliability.

Qualifications

• Bachelor's degree or equivalent practical experience
• 12+ years of software engineering experience with large-scale distributed or infrastructure systems
• Experience setting technical direction across organizational boundaries
• Experience applying AI or machine learning to production problems
• Demonstrated production deployment impact
• Experience diagnosing complex production systems using telemetry, code, configuration, dependencies
• Experience coding in languages such as C++, Java, Python, Rust, or equivalent
• Recent hands-on experience shipping complex production systems
• Experience influencing senior engineers and leaders without direct organizational authority

Responsibilities

• Define the technical vision and architecture for agentic reliability systems across Meta
• Personally design, code, and ship production agentic systems for complex infrastructure problems
• Lead the development of an AI agent for production incident investigation and mitigation, advancing it toward accurate, trusted, and safely supervised autonomous action
• Develop major improvements in agent reasoning, context, tool use, planning, evaluation, learning, and safe execution
• Explore and apply techniques including automated hill climbing, fine-tuning, reinforcement learning, model routing, distillation, pruning, and inference optimization, selecting the simplest approach that produces measurable gains
• Identify new high-value applications of AI across incident prevention, detection, mitigation, observability, and infrastructure operations
• Move rapidly from ambiguous problems to prototypes, validate them against real production workloads, and develop successful approaches into reliable systems at scale
• Build evaluation and experimentation systems that connect agent quality to outcomes such as investigation accuracy, successful mitigation, incident duration, and reduced operational work
• Build closed-loop improvement systems that turn production outcomes into evaluations, experiments, and better agent behavior
• Establish architectures and guardrails for production actions, including authorization, independent validation, auditability, rollback, and human oversight
• Partner with Infrastructure, AI, Product, and Reliability leaders to integrate agentic capabilities into Meta’s production ecosystem
• Influence technical strategy across organizations and mentor other engineers working on distributed systems and applied AI

Skills

Distributed systems

AI/ML in production

C++

Java

Python

Rust

Telemetry & debugging

Leadership without authority

Education

Bachelor's degree in CS or equivalent

Tools

Git

Docker

Kubernetes

CI/CD pipelines

Job description

Meta seeks an experienced Software Engineer to build the next generation of AI systems for production reliability and to lead the development of autonomous AI agents for incident investigation and mitigation at scale.

You will prototype, evaluate, and ship AI-enabled infrastructure solutions, working hands-on with production data and code, all under senior leadership supervision to ensure safety and reliability.