AI Solutions Analyst: AI Requirements & Evaluation

Public Consulting Group; Boise (ID); On-site; USD 56,000 - 115,000; Full time

Job summary

Public Consulting Group is seeking an AI Solutions Analyst to support the design, delivery, and monitoring of AI-enabled solutions within state government environments. The role translates policy and program needs into structured requirements and uses evaluation data to diagnose and improve system output.

The ideal candidate combines business analysis with practical AI fluency, analyzing evaluation results with basic statistics, iterating prompts, and balancing performance, cost, and

Qualifications

• Bachelor’s degree from an accredited institution.
• 4+ years of experience as a Business Analyst, Solutions Analyst, or Consultant.
• Experience translating complex needs into structured deliverables.
• Client-facing experience in requirements sessions and workshops.
• Working knowledge of basic statistics and interpreting evaluation results.
• Hands-on experience iterating on prompts/instructions for LLM-based systems.
• Working knowledge of AI systems, including behavior and limitations.
• Technical understanding of system architecture, data flows, APIs, and integrations.

Responsibilities

• Support and lead client requirements sessions and discovery discussions
• Translate policy and operational workflows into structured requirements
• Serve as a bridge between stakeholders and technical teams
• Design evaluation test sets and analyze results to improve AI outputs
• Iterate prompts and instructions to address root causes identified through evaluation
• Collaborate with technical leads on tuning cycles within review processes
• Support broader program operations and cross-workstream coordination

Skills

Business analysis

Client-facing

Requirements sessions

Statistical reasoning

LLM prompts iteration

AI systems knowledge

System architecture basics

Education

Bachelor’s degree

Job description

Public Consulting Group is seeking an AI Solutions Analyst to support the design, delivery, and monitoring of AI-enabled solutions within state government environments. The role translates policy and program needs into structured requirements and uses evaluation data to diagnose and improve system output.

The ideal candidate combines business analysis with practical AI fluency, analyzing evaluation results with basic statistics, iterating prompts, and balancing performance, cost, and