AI Safety QA Reviewer & Project Coordinator

mpathic; Washington (District of Columbia); On-site; USD 90,000 - 130,000; Full time

Job summary

mpathic is seeking an experienced QA Reviewer & Project Coordinator to join our fast-paced startup team in the Washington, DC area. The role blends hands-on AI evaluation with day-to-day project coordination to keep deliverables on track and maintain high-quality outputs.

You will review AI content for safety and accuracy, participate in calibration, and help refine QA processes while coordinating staffing and project workflows.

Qualifications

• Familiarity with ChatGPT, Claude, Gemini, or other large language models.
• Excellent written communication and documentation skills.
• Strong organizational skills with exceptional attention to detail.
• Ability to manage multiple priorities simultaneously.
• Ability to work independently while collaborating across teams.
• Comfortable in a fast-paced startup environment with evolving priorities.

Responsibilities

• Review AI content for accuracy, safety, empathy, and policy compliance.
• Conduct QA reviews of expert evaluations and annotations.
• Participate in calibration sessions to ensure reviewer consistency and quality.
• Help improve QA workflows, reviewer documentation, and operational processes.
• Role play clinical scenarios with AI systems to evaluate behavior across diverse situations.
• Perform red teaming to identify safety risks and edge cases.
• Develop and refine evaluation rubrics, taxonomies, personas, and scoring guidelines.
• Document model inconsistencies and safety concerns for improvement.
• Collaborate with researchers and engineers to improve AI behavior with clinical feedback.
• Maintain confidentiality while handling sensitive clinical content.
• Support day-to-day execution of AI safety and evaluation projects.
• Track project timelines, deliverables, and reviewer assignments.
• Coordinate review queues and balance workloads across project teams.
• Monitor progress and identify risks, blockers, or quality issues.
• Maintain project trackers, documentation, and reporting dashboards.
• Assist with staffing coordination as project needs evolve.
• Facilitate project meetings and document action items.

Skills

QA Review

AI Evaluation

Project Coordination

Documentation

Calibrations

Red Teaming

Stakeholder comms

Clinical Content

Confidentiality

Startup environment

Job description

mpathic is seeking an experienced QA Reviewer & Project Coordinator to join our fast-paced startup team in the Washington, DC area. The role blends hands-on AI evaluation with day-to-day project coordination to keep deliverables on track and maintain high-quality outputs.

You will review AI content for safety and accuracy, participate in calibration, and help refine QA processes while coordinating staffing and project workflows.