Utilization Management Nurse - AI Evaluation

Braintrust; United States; Remote; USD 43,000 - 62,000; Part time

Job summary

Turing is seeking a remote contractor in the United States with utilization management nursing expertise to develop AI evaluation tasks and clinical scenarios. The role focuses on creating realistic cases, evaluating model responses and ensuring clinically defensible standards within the specialty.

You will build longitudinal clinical tasks, assess documentation quality and patient safety, and calibrate rubrics across fast-paced review cycles.

Qualifications

• At least 3 years of relevant professional experience, with current practice or recent practice within the last three years.
• An active RN license or another recognized credential appropriate to utilization management nursing.
• A relevant healthcare degree or equivalent practical experience.
• Strong clinical reasoning, chart-review, documentation and written communication skills, with attention to clinically defensible conclusions and patient safety.
• Ability to follow standardized rubrics, incorporate critique and work through fast-paced review and calibration cycles.

Responsibilities

• Create challenging clinical tasks, longitudinal-chart scenarios, reference answers and evaluation rubrics focused on utilization management, prior authorization, medical necessity and payer appeals.
• Synthesize fragmented records, identify contradictions and missing actions, and assess clinical reasoning, documentation quality and patient safety.
• Apply structured rubrics, review specialist feedback and refine cases through calibration cycles.

Skills

Clinical reasoning

Chart review

Written communication

Patient safety

Rubrics following

Education

Nursing or healthcare degree

Job description

• Rate: $38/hr


• Hours: 20 hours / week


• Experience: 3 - 5 years


• Location: Alabama, USA | Alaska, USA + 49 more

Bring your utilization management nursing expertise to the development and evaluation of advanced AI systems. You will create realistic clinical cases, evaluate model responses and help establish clinically defensible standards within your specialty.

What You Will Do

Create challenging clinical tasks, longitudinal-chart scenarios, reference answers and evaluation rubrics focused on utilization management, prior authorization, medical necessity and payer appeals.

Synthesize fragmented records, identify contradictions and missing actions, and assess clinical reasoning, documentation quality and patient safety.

Apply structured rubrics, review specialist feedback and refine cases through calibration cycles.

What You Bring

At least 3 years of relevant professional experience, with current practice or recent practice within the last three years.

An active RN license or another recognized credential appropriate to utilization management nursing.

A relevant healthcare degree or equivalent practical experience.

Strong clinical reasoning, chart-review, documentation and written communication skills, with attention to clinically defensible conclusions and patient safety.

Ability to follow standardized rubrics, incorporate critique and work through fast-paced review and calibration cycles.

Nice to Have

Familiarity with US clinical guidelines, payer policies, regulatory requirements and healthcare workflows.

Experience with AI evaluation, clinical content or assessment development, expert review or quality improvement.

Engagement

Remote contractor project for US-based professionals, expected to last 12 weeks. Target start: November 2, 2026.

Part-time (20 hours per week) or full-time (40 hours per week), with four hours of overlap with Pacific working hours.

Selection includes an application review and assessment.

Compensation

USD 38 per hour.

Company: Turing