Policy & Data Quality Architect - Hybrid

GreenLight Workforce Solutions Inc; United States; Hybrid; USD 70,000 - 110,000; Part time

Job summary

GreenLight Workforce Solutions Inc is seeking a Policy & Data Quality Specialist (Contract) to train AI models, ensure policy-adherent decisions, and manage golden sets and vendor calibration. The role may involve handling sensitive content.

Hybrid office-based in the United States with cross-functional collaboration across operations, policy, and engineering teams. Experience in content moderation is valuable but not required.

Qualifications

• 4+ years of experience in technology consulting, content moderation, quality assurance, or a related field.
• Strong understanding of policy development, moderation procedures, and guidelines.
• Experience developing evals and golden sets.
• Familiarity with data analysis and reporting tools preferred.
• Strong attention to detail and ability to maintain accuracy in a fast-paced environment.
• Excellent analytical, problem-solving, and communication skills.
• Ability to work independently and collaboratively as part of a team.
• Experience working with vendors or external partners is valuable.

Responsibilities

• Policy & Data Quality Assurance: Review and evaluate decisions to ensure accuracy, consistency, and adherence to policies and guidelines.
• Golden Set Creation: Develop and maintain golden sets of content to test and calibrate models and vendor performance.
• Vendor Site Calibration: Collaborate with vendor sites to identify improvements and implement calibration plans.
• Vendor Management: Build and maintain relationships with vendors, providing guidance and performance metrics.
• Process and Policy Improvement: Identify opportunities to improve policies, workflows, and tools with stakeholders.
• Data Analysis: Analyze data and metrics to identify trends informing QA strategies and vendor performance.
• Communication: Coordinate with operations, policy, engineering, and leadership for alignment on QA initiatives.
• Training and Development: Participate in training to stay up-to-date on policies and industry best practices.

Skills

Policy development

Data analysis

Quality assurance

Vendor management

Communication

Training & development

Teamwork

Job description

GreenLight Workforce Solutions Inc is seeking a Policy & Data Quality Specialist (Contract) to train AI models, ensure policy-adherent decisions, and manage golden sets and vendor calibration. The role may involve handling sensitive content.

Hybrid office-based in the United States with cross-functional collaboration across operations, policy, and engineering teams. Experience in content moderation is valuable but not required.