AI Build Agent Engineering Manager

ServiceNow; Santa Clara (CA); On-site; USD 166,500 - 291,400; Full time

Benefits offered by this job

Health plans

401(k) Plan with company match

ESPP

Matching donations

Flexible time away plan

Family leave programs

Job summary

ServiceNow is seeking a Software Engineering Manager for Build Agent to lead an 8-engineer team focused on evaluation infrastructure, model benchmarking, and telemetry. The role drives strategy, cross-team collaboration, and scalable processes to ensure robust evaluation of AI models within the platform.

You will own the evaluation roadmap, coordinate across teams, and present results to executives, while shaping the future of our AI coding assistant across ServiceNow metadata types and UI

Qualifications

• Direct experience building or leading evaluation systems for LLM-based products.
• Experience driving cross-team accountability without direct authority.
• Working understanding of coding agent architecture: tool use, agentic loops, context management.
• Experience critically evaluating foundation models and distinguishing capability gaps from tuning artifacts.
• Ability to execute against ambiguous priorities with risk-aware decisions.
• People management experience; managing 8+ engineers is a plus.

Responsibilities

• Own eval strategy and roadmap: prompt set design, scoring methodology, failure-mode taxonomy, and telemetry instrumentation.
• Coordinate across the multiple teams contributing to Build Agent to arbitrate quality standards and drive eval findings to committed, owned fixes.
• Lead model benchmarking efforts, making data-backed recommendations on model support decisions.
• Manage the daily activities of an 8-engineer team, including staffing, mentoring, and performance management, while scaling processes to remove bottlenecks.
• Solve ambiguous, cross-cutting problems where eval signal, model capability, and platform architecture intersect.
• Represent eval results and model support recommendations to cross-functional and executive stakeholders.

Skills

People management

LLM evaluation

Cross-team accountability

Agent architecture

Model benchmarking

Ambiguity handling

Job description

ServiceNow is seeking a Software Engineering Manager for Build Agent to lead an 8-engineer team focused on evaluation infrastructure, model benchmarking, and telemetry. The role drives strategy, cross-team collaboration, and scalable processes to ensure robust evaluation of AI models within the platform.

You will own the evaluation roadmap, coordinate across teams, and present results to executives, while shaping the future of our AI coding assistant across ServiceNow metadata types and UI