Remote HITL QA Analyst for AI Quality & Improvements

Ninja Partners

United States

Remote

USD 60.000 - 90.000

Vollzeit

Vor 7 Tagen
Sei unter den ersten Bewerbenden

Eine vollständige Bewerbung in einer Minute

Maßgeschneiderter Lebenslauf und Anschreiben – versandbereit.

Schaffe es an den ATS-Filtern vorbei

Benefits dieser Stelle

Full-time
Competitive pay
Gov't benefits
Retirement match
Life Insurance
HMO day 1
PTO + birthday leave
Bonus plans
Training programs
Referral program
Nice office
Free lunch

Zusammenfassung

SupportNinja is seeking a HITL Quality Analyst to evaluate AI outputs against established standards, identify and track defects, and drive continuous improvements across teams in a remote setup. You will monitor quality trends, maintain defect logs, and prepare performance summaries for stakeholders.

The role emphasizes data-driven decision-making, collaboration, and adherence to processes to ensure high-quality AI support operations.

Qualifikationen

  • Minimum of two (2) years of experience in quality assurance, quality evaluation, compliance, auditing, or related field.
  • Experience evaluating work against defined quality standards, scorecards, policies, or procedures.
  • Experience identifying, categorizing, documenting, and tracking defects or quality issues.
  • Calibration experience to ensure scoring consistency preferred.
  • Strong analytical and critical-thinking skills with pattern identification.
  • Excellent written and verbal communication to document findings clearly.
  • Ability to manage multiple priorities in a fast-paced environment.
  • Commitment to data-driven decision making.

Aufgaben

  • Review and evaluate AI outputs using established standards and defect classification.
  • Identify, classify, document, and track defects for measurement and trend analysis.
  • Maintain accurate defect logs and resolution tracking through completion.
  • Analyze quality metrics to identify recurring issues, risks, and opportunities.
  • Coordinate with Knowledge Management, AI Tuning, Governance, and Operations.
  • Validate effectiveness of corrective actions via follow-up evaluations.
  • Prepare reports, dashboards, and performance summaries for stakeholders.
  • Participate in calibration sessions to ensure consistent scoring across reviewers.
  • Identify opportunities to improve quality processes, reporting, and evaluation.

Kenntnisse

Quality assurance
Quality evaluation
Analytical thinking
Written communication
Verbal communication
Time management
Collaboration
Data-driven decisions

Jobbeschreibung

SupportNinja is seeking a HITL Quality Analyst to evaluate AI outputs against established standards, identify and track defects, and drive continuous improvements across teams in a remote setup. You will monitor quality trends, maintain defect logs, and prepare performance summaries for stakeholders.

The role emphasizes data-driven decision-making, collaboration, and adherence to processes to ensure high-quality AI support operations.

Hol dir deinen kostenlosen, vertraulichen Lebenslauf-Check.

oder ziehe deine Datei hierhin.

Similar jobs

Ähnliche Jobs, die dir auch gefallen könnten

HITL Quality Analyst
HITL Quality Analyst

Ninja Partners • USA

Remote
USD 60.000 - 90.000
Full-time
Competitive pay
Gov't benefits
+9
Remote Quality & AI Operations Analyst
Remote Quality & AI Operations Analyst

Vida Health • USA

Remote
USD 80.000 - 90.000
Quality Analyst - AI-Driven QA & Process Improvement
Quality Analyst - AI-Driven QA & Process Improvement

Ihcus • El Paso (TX)

Vor Ort
USD 33.000 - 41.000
Remote QA Engineer - AI-Enhanced Testing & Automation
Remote QA Engineer - AI-Enhanced Testing & Automation

Learntastic • USA

Remote
USD 85.000 - 125.000
QA Test Engineer- Remote
QA Test Engineer- Remote

YO AI Labs • USA

Remote
USD 55.000 - 96.000
QA Engineer - Remote
QA Engineer - Remote

YO AI Labs • New York (NY)

Remote
USD 55.000 - 103.000
Software Test Engineer - Remote
Software Test Engineer - Remote

YO AI Labs • New York (NY)

Remote
USD 41.000 - 83.000
Senior QA Quality Cell Lead - AI-Driven Testing (Remote)
Senior QA Quality Cell Lead - AI-Driven Testing (Remote)

HumanIT Digital Consulting • USA

Remote
USD 120.000 - 160.000
QA Engineer - Remote
QA Engineer - Remote

YO AI Labs • USA

Remote
USD 55.000 - 96.000
Remote Quality Assurance Team Lead
Remote Quality Assurance Team Lead

SupportNinja • USA

Remote
USD 90.000 - 140.000
Competitive Compensation
Company-Provided Equipment
Retirement Savings Program
+4