RN/NP Clinical Quality Reviewer

OpenKrill; United States; On-site; USD 83,000 - 124,000; Part time

Job summary

Openkrill is seeking a RN/NP to serve as a Clinical Quality Reviewer for AI-driven agent conversations. The role focuses on acute symptom triage, hypertension/CHF management, diabetes management, and travel health, with evaluation, coaching, and feedback duties.

This is a part-time, remote contract (1099) offering up to 25 hours weekly and flexible scheduling. Ideal candidates hold active RN or NP licenses in the United States with relevant clinical experience and familiarity with evidence-based

Qualifications

• Registered Nurses: Active, unrestricted RN license in the United States.
• Nurse Practitioners: Active, unrestricted NP license in the United States, with current board certification (ANCC or AANP).
• Hands-on professional experience conducting protocol-based virtual or telephone clinical triage; and/or
• Hands-on clinical experience directly managing patients with hypertension and/or congestive heart failure (CHF).
• For candidates with hypertension/CHF management experience, hands-on experience prescribing, adjusting, or titrating medications for these patients.
• Strong working knowledge of evidence-based protocols and clinical practice guidelines relevant to acute triage and/or hypertension and CHF management.

Responsibilities

• Review recorded and simulated AI agent interactions involving acute symptom triage and assess triage, escalation, and de-escalation decisions.
• Evaluate AI agent conversations involving hypertension and CHF management, including medication titration, for clinical accuracy and adherence to protocols.
• Review agent conversations related to diabetes management and insulin titration for clinical accuracy and guideline adherence.
• Evaluate agent-delivered travel health guidance, including pre-travel counseling, vaccination recommendations, and risk assessment.
• Review AI agent calls for adherence to established clinical protocols and medical management.
• Score and annotate agent performance using structured evaluation rubrics.
• Perform clinical data annotation by rewriting or correcting AI agent responses to align with evidence-based protocols.
• Identify clinical safety concerns, inappropriate recommendations, gaps in agent reasoning.
• Provide clear feedback to clinical and product teams for agent refinement.
• Participate in case reviews to ensure consistent evaluation standards.
• Help develop-test scenarios for ongoing agent QA.

Skills

Virtual triage experience

Hypertension management

CHF management

Diabetes management

Clinical feedback writing

Evidence-based protocols

Education

RN license (US)

NP license with board certification (ANCC/AANP)

Job description

RN/NP CLINICAL QUALITY REVIEWER

Primary Care, Acute Symptom Triage & Travel Health | Contract, up to 25 hrs/week

ABOUT THE ROLE

We are seeking Nurses & Nurse Practitioners with clinical experience in one or more of the following areas:

• Telephone or virtual acute symptom triage
• Hypertension and congestive heart failure (CHF) management
• Medication titration for hypertension and/or CHF
• Diabetes management and insulin titration
• Travel health

to serve as a subject matter expert supporting the evaluation of AI-driven clinical agents. In this role, you will evaluate agent conversations and recommendations spanning acute symptom triage and escalation decisions, insulin/diabetes titration, and pre-travel health guidance, ensuring clinical accuracy, guideline adherence, and patient safety. This is a part-time, remote contract position (1099) requiring up to 25 hours per week, with flexible scheduling.

KEY RESPONSIBILITIES

• Review recorded and simulated AI agent interactions involving acute symptom triage and assess the appropriateness of triage, escalation, and de-escalation decisions.
• Evaluate AI agent conversations involving hypertension and CHF management, including medication titration, for clinical accuracy and adherence to evidence-based protocols.
• Review agent conversations related to diabetes management and insulin titration for clinical accuracy and guideline adherence.
• Evaluate agent-delivered travel health guidance, including pre-travel counseling, vaccination recommendations, and destination-specific risk assessment.
• Review AI agent calls for adherence to established clinical protocols and appropriate medical management.
• Score and annotate agent performance using structured evaluation rubrics.
• Perform clinical data annotation by rewriting or correcting AI agent responses to align with evidence-based protocols and clinical practice guidelines.
• Identify clinical safety concerns, inappropriate recommendations, edge cases, and gaps in agent clinical reasoning.
• Provide clear, actionable written feedback to clinical and product teams to inform agent refinement.
• Participate in periodic case review and calibration sessions with other clinical SMEs to ensure consistent evaluation standards.
• Help develop and refine test scenarios used in ongoing agent quality assurance.

QUALIFICATIONS

• Registered Nurses: Active, unrestricted RN license in the United States.
• Nurse Practitioners: Active, unrestricted NP license in the United States, with current board certification (ANCC or AANP).
• Hands-on professional experience conducting protocol-based virtual or telephone clinical triage; and/or
• Hands-on clinical experience directly managing patients with hypertension and/or congestive heart failure (CHF).
• For candidates with hypertension/CHF management experience, hands-on experience prescribing, adjusting, or titrating medications for these patients.
• Strong working knowledge of evidence-based protocols and clinical practice guidelines relevant to acute triage and/or hypertension and CHF management.

RECOMMENDED

• It is not a requirement that candidates have all of the recommended criteria
• Experience in telephone triage or nurse advice line settings.
• Experience in travel medicine, occupational health, or pre-travel consultation.
• Familiarity with CDC and other travel medicine guidelines.
• Prior experience in clinical quality assurance, utilization review, or case review.
• Familiarity with AI-assisted clinical tools or digital health platforms.

ENGAGEMENT DETAILS

• Contract (1099) position, up to 25 hours per week.
• Fully remote; flexible scheduling.
• Hourly compensation, commensurate with experience.
• Engagement expected to run in support of ongoing agent development and FDA evaluation milestones.

WHY JOIN HIPPOCRATIC AI

Reinvent healthcare with AI that puts safety first. We're building the world's first healthcare-only, safety-focused LLM - a breakthrough platform designed to transform patient outcomes at a global scale. This is category creation.

Work with the people shaping the future. Hippocratic AI was co-founded by CEO Munjal Shah and a team of physicians, hospital leaders, AI pioneers, and researchers from institutions like El Camino Health, Johns Hopkins, Washington University in St. Louis, Stanford, Google, Meta, Microsoft, and NVIDIA.

Backed by the world’s leading healthcare and AI investors. We recently raised a $126M Series C at a $3.5B valuation, led by Avenir Growth, bringing total funding to $404M with participation from CapitalG, General Catalyst, a16z, Kleiner Perkins, Premji Invest, UHS, Cincinnati Children’s, WellSpan Health, John Doerr, Rick Klausner, and others.

Build alongside the best in healthcare and AI. Join experts who’ve spent their careers improving care, advancing science, and building world-changing technologies - ensuring our platform is powerful, trusted, and truly transformative.

EQUAL OPPORTUNITY

Hippocratic AI is an equal opportunity employer. We do not discriminate on the basis of race, color, religion, national origin, sex, age, disability, sexual orientation, gender identity or expression, genetic information, military or veteran status, or any other characteristic protected by applicable law. We are committed to building a team that reflects the patients we serve. We actively encourage applications from candidates of all backgrounds. If you require accommodations during the hiring process, please contact [e-mail].