AI Solutions Analyst — Public Sector AI Evaluator

Public Consulting Group; Juneau (AK); On-site; USD 56,000 - 115,000; Full time

Job summary

Public Consulting Group seeks an AI Solutions Analyst to design, deliver, and monitor AI-enabled solutions in state government environments. You will translate policy needs into concrete requirements and analyze evaluation data to improve system output, balancing performance, cost, and explainability.

The role bridges client-facing work with hands-on responsibility for AI behavior in enterprise settings, focusing on evaluation-driven tuning and scoped delivery.

Qualifications

• Bachelor’s degree from an accredited institution.
• 4+ years of experience as a Business Analyst, Solutions Analyst, or Consultant.
• Experience translating complex needs into structured deliverables.
• Client-facing experience in requirements sessions and workshops.
• Working knowledge of basic statistics — sampling and distributions.
• Hands-on experience iterating prompts/instructions for LLM-based systems.
• Working knowledge of AI systems, agentic workflows, and model behavior.
• Understanding of tradeoffs in context, cost, and explainability.

Responsibilities

• Support and lead client requirements sessions and discovery discussions.
• Translate policy and operational workflows into structured requirements.
• Serve as a bridge between stakeholders and technical teams.
• Design AI-enabled solutions and define use cases.
• Develop and document AI workflows.
• Design evaluation test sets with representative samples.
• Analyze evaluation results to identify where the system underperforms.
• Iterate on prompts and instructions to address root causes.
• Support broader program operations to scale delivery.

Skills

Strong communication skills

Bachelor's degree

4+ years experience

Client-facing

Statistics basics

Prompts iteration

AI systems knowledge

System architecture basics

Education

Bachelor's degree

Tools

AWS Bedrock

Azure

Job description

Public Consulting Group seeks an AI Solutions Analyst to design, deliver, and monitor AI-enabled solutions in state government environments. You will translate policy needs into concrete requirements and analyze evaluation data to improve system output, balancing performance, cost, and explainability.

The role bridges client-facing work with hands-on responsibility for AI behavior in enterprise settings, focusing on evaluation-driven tuning and scoped delivery.