AI Agent Performance & Operations Analyst

Crossing Hurdles

United States

On-site

USD 55,000 - 75,000

Full time

6 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Crossing Hurdles is seeking an operations-focused professional to run realistic task simulations, evaluate AI agent behavior, and ensure comprehensive documentation.

You will assess performance across scenarios such as billing, returns, bookings, and forms, and provide concrete feedback. The role includes participating in resume evaluation and interview stages via LinkedIn Easy Apply.

Qualifications

  • Experience in engineering, business management, or office/operations.
  • Experience using AI in daily life.
  • Detail-oriented with strong instruction-following and documentation skills.

Responsibilities

  • Run real-life scenarios such as bills, returns, email follow-ups, bookings, shopping, groceries, travel, and forms.
  • Approve or stop the AI agent at key steps during task execution.
  • Screen record every attempt to ensure accurate documentation.
  • Score each run based on completion, quality, control issues, satisfaction, and time.
  • Share clear written feedback on the agent experience.

Skills

Engineering
Business management
Office operations
AI in daily life

Job description

Crossing Hurdles is seeking an operations-focused professional to run realistic task simulations, evaluate AI agent behavior, and ensure comprehensive documentation.

You will assess performance across scenarios such as billing, returns, bookings, and forms, and provide concrete feedback. The role includes participating in resume evaluation and interview stages via LinkedIn Easy Apply.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

AI Operations & Quality Analyst
AI Operations & Quality Analyst

Crossing Hurdles • United States

On-site
USD 65,000 - 90,000
AI Agent Deployment Engineer — Customer-Facing
AI Agent Deployment Engineer — Customer-Facing

Level AI • United States

Remote
USD 140,000 - 190,000
AI Chatbot Evaluation & Operations Analyst
AI Chatbot Evaluation & Operations Analyst

Crossing Hurdles • United States

On-site
USD 65,000 - 100,000
AI Analyst | $45/hr Remote
AI Analyst | $45/hr Remote

Crossing Hurdles • United States

On-site
USD 65,000 - 90,000
Remote AI Agent Operations & Automation Specialist
Remote AI Agent Operations & Automation Specialist

HealthEquity, Inc. • United States

On-site
USD 92,000 - 117,000
Medical, dental, vision
401(k) match
Unlimited PTO
AI Agent Evaluator - Remote
AI Agent Evaluator - Remote

YO AI Labs • New York (NY)

Remote
USD 55,000 - 83,000
Research Analyst | $45/hr Remote
Research Analyst | $45/hr Remote

Crossing Hurdles • United States

On-site
USD 55,000 - 75,000
AI Agent Performance Architect
AI Agent Performance Architect

Rivian • Irvine (CA)

On-site
USD 154,000 - 193,000
Annual bonus
Equity awards
Benefits package
AI Agent Evaluation Specialist
AI Agent Evaluation Specialist

OpenTrain AI, Inc. • United States

Remote
USD 34,000 - 62,000
Everyday AI Agent Tester - Remote
Everyday AI Agent Tester - Remote

YO AI Labs • New York (NY)

Remote
USD 20,000 - 40,000