Remote AI Solutions Analyst — Public Sector Evaluation

Public Consulting Group; Jackson (MS); On-site; USD 100,000 - 120,000; Full time

Job summary

Public Consulting Group (PCG) is seeking an AI Solutions Analyst to support the design, delivery, and ongoing monitoring of AI-enabled solutions within state government environments.

This role bridges client-facing requirements work with hands-on responsibility for how the AI system actually performs — translating policy and program needs into structured requirements, and using evaluation data to diagnose and improve system output quality.

Qualifications

• Bachelor’s degree from an accredited institution.
• 4+ years of experience as a Business Analyst, Solutions Analyst, or Consultant.
• Strong communication skills.
• Experience translating complex needs into structured deliverables.
• Client-facing experience in requirements sessions and workshops.
• Working knowledge of basic statistics—sample sizes, error rates, false positive/negative distinctions, and distributions.
• Hands-on experience iterating on prompts/instructions for LLM-based systems in production or near-production.
• Working knowledge of AI systems, including behavior, limitations, and agentic workflows.
• Practical understanding of model selection tradeoffs, context/cost constraints, and agentic workflow limitations beyond prompt-level interaction with frontier models.
• Technical understanding of system architecture, data flows, APIs, and integrations.

Responsibilities

• Lead client requirements sessions and discovery discussions.
• Translate policy and operational workflows into structured requirements.
• Bridge between stakeholders and technical teams.
• Design AI-enabled solutions and define use cases.
• Develop and document AI workflows.
• Design evaluation test sets with representative samples across cases.
• Analyze evaluation results using basic statistics to identify where the system underperforms.
• Iterate on prompts and instructions to address root causes from evaluation analysis.
• Identify tradeoffs related to performance, cost, token usage, and explainability.
• Partner with technical leads on tuning cycles within established review and sign-off processes.
• Support broader program operations and cross-workstream coordination.

Skills

Communication skills

4+ years exp

Client-facing

Stats basics

Prompt tuning

AI system knowledge

System architecture

Education

Bachelor's degree

Job description

Public Consulting Group (PCG) is seeking an AI Solutions Analyst to support the design, delivery, and ongoing monitoring of AI-enabled solutions within state government environments.

This role bridges client-facing requirements work with hands-on responsibility for how the AI system actually performs — translating policy and program needs into structured requirements, and using evaluation data to diagnose and improve system output quality.