AI Implementation Quality & Evaluation Lead (Remote)

Granicus; United States; On-site; USD 80,000 - 105,700; Full time

Benefits offered by this job

Flexible Time Off

Company-Wide Wellbeing Days

Work From Home Reimbursement

Multiple Health Plan Options

Paid Parental Leave

Generous 401(k) match

Online Learning Platforms

Job summary

Granicus is seeking a motivated AI Implementation Quality Analyst to ensure the quality and safety of AI responses. This client-facing role involves working closely with clients to understand their needs and assessing AI responses against established standards.

The position requires strong analytical skills and experience in AI evaluation. Key responsibilities include developing evaluation frameworks and documenting findings to support both product and engineering teams post-launch.

Qualifications

• Strong analytical judgment and attention to detail.
• Experience reviewing or auditing structured outputs.
• Comfort applying detailed guidelines consistently.

Responsibilities

• Partner with clients to understand use cases and success criteria.
• Translate client requirements into evaluation frameworks.
• Review and score AI responses using standard rubrics.

Skills

Analytical judgment

Attention to detail

Written communication skills

Experience in AI evaluation

Comfort with spreadsheets and evaluation tools

Job description

Granicus is seeking a motivated AI Implementation Quality Analyst to ensure the quality and safety of AI responses. This client-facing role involves working closely with clients to understand their needs and assessing AI responses against established standards.

The position requires strong analytical skills and experience in AI evaluation. Key responsibilities include developing evaluation frameworks and documenting findings to support both product and engineering teams post-launch.