AI Operations & Quality Analyst

Crossing Hurdles; United States; On-site; USD 65,000 - 90,000; Full time

Job summary

Crossing Hurdles is seeking a detail-oriented Operations/QA professional to oversee real-life scenario testing of AI agents. You will run diverse tasks such as bills, returns, emails, bookings, shopping, and travel to evaluate performance.

You will pause or approve the agent at key steps, record every attempt for documentation, and score runs on completion, quality, and time, then share actionable feedback to improve the agent experience.

Qualifications

• Strong experience in engineering, business management, or office/operations.
• Detail-oriented and great at following instructions and documenting each step.
• Generalists welcome, domain experts preferred.
• No coding or AI background needed.

Responsibilities

• Run real-life scenarios such as bills, returns, email follow-ups, bookings, shopping, groceries, travel, family logistics, outings, and forms.
• Approve or stop the AI agent at key steps during task execution.
• Screen record every attempt to ensure accurate documentation.
• Score each run based on completion, quality, control issues, satisfaction, and time.
• Share clear written feedback on the agent experience.

Skills

Experience in engineering/business/ops

Detail-oriented

Instruction following

Documentation

No coding needed

Job description

Crossing Hurdles is seeking a detail-oriented Operations/QA professional to oversee real-life scenario testing of AI agents. You will run diverse tasks such as bills, returns, emails, bookings, shopping, and travel to evaluate performance.

You will pause or approve the agent at key steps, record every attempt for documentation, and score runs on completion, quality, and time, then share actionable feedback to improve the agent experience.