AI QA Lead: Database Systems Evaluation (Remote)

AuraOne; United States; À distance; USD 15 000 - 25 000; Plein temps

Résumé du poste

AuraOne is seeking a Database Systems Evaluation Expert on a remote contractor basis. You will review AI outputs against enterprise workflows, policy standards, and playbooks to ensure accuracy and adherence.

You will grade tone, escalation logic, and stakeholder fit, flag risks, and document next steps for model training. The role requires direct experience with database systems evaluation operations, strong written reasoning, and reliable async availability of at least 10 hours per week.

Qualifications

• Direct working experience in database systems evaluation specialist operations.
• Clear written reasoning that names the policy or workflow being applied.
• Ability to apply multi-page rubrics consistently across long batches.
• Reliable async availability for at least 10 hours per week.

Responsabilités

• Review AI outputs against current database systems evaluation specialist operations workflows, playbooks, and firm policy for Database Systems Evaluation Expert assignments.
• Grade tone, escalation logic, and stakeholder fit on a structured rubric.
• Flag operational risk, missed escalations, and policy-adherence gaps with severity tags.
• Capture the right next step so the modeling team can train on it.
• Adjudicate disputed treatments against published playbooks or firm guidance.
• Maintain reviewer-quality scores in inter-rater calibration cycles.

Connaissances

Operational review

Policy adherence

Workflow judgment

Stakeholder communication

Database Systems Evaluation specialist

Description du poste

AuraOne is seeking a Database Systems Evaluation Expert on a remote contractor basis. You will review AI outputs against enterprise workflows, policy standards, and playbooks to ensure accuracy and adherence.

You will grade tone, escalation logic, and stakeholder fit, flag risks, and document next steps for model training. The role requires direct experience with database systems evaluation operations, strong written reasoning, and reliable async availability of at least 10 hours per week.