AI Solutions Analyst

Public-Consulting-Group; United States; Remote; USD 100,000 - 120,000; Full time

Benefits offered by this job

Medical benefits

Dental benefits

401k

PTO

Parental leave

Bereavement leave

Job summary

Public Consulting Group LLC is seeking an AI Solutions Analyst to design, deliver, and monitor AI-enabled solutions for state government environments. You will translate policy needs into requirements and use evaluation data to shape system behavior, bridging client facing work with hands-on analysis.

You will analyze results with basic statistics, iterate prompts, and collaborate with technical leads on tuning within established governance processes.

Qualifications

• Bachelor’s degree and 4+ years as a Business Analyst, Solutions Analyst, or Consultant.
• Client-facing experience in requirements sessions and workshops.
• Working knowledge of statistics sufficient to design evaluation sets and interpret results.
• Hands-on experience iterating prompts/instructions for LLM-based systems in production.
• Knowledge of AI systems, behavior, limitations, and agentic workflows.
• Understanding of model selection tradeoffs, context/cost constraints, and workflows beyond prompts.
• Familiarity with cloud AI platforms (e.g., AWS Bedrock, Azure) and governance considerations.

Responsibilities

• Facilitate client requirements sessions and translate policy into structured deliverables.
• Design AI-enabled solution workflows and evaluate performance with test sets.
• Analyze evaluation results using basic statistics to diagnose underperformance.
• Iterate on prompts and instructions to address root causes identified in analyses.
• Collaborate with technical leads on tuning cycles within governance processes.
• Support broader program operations and cross-workstream coordination as needed.

Skills

Strong communication

Client-facing

Statistics basics

Prompt engineering

AI systems knowledge

Requirements sessions

Business analysis

LLM evaluation iteration

Education

Bachelor's degree

Tools

AWS Bedrock

Azure

Job description

Public Consulting Group LLC (PCG) is a leading public sector solutions implementation and operations improvement firm that partners with health, education, and human services agencies to improve lives. Founded in 1986, PCG employs approximately 2,000 professionals throughout the U.S.—all committed to delivering solutions that change lives for the better. The firm is a member of a family of companies with experience in all 50 states, and clients in three Canadian provinces and Europe. PCG offers clients a multidisciplinary approach to meet challenges, pursue opportunities, and serve constituents across the public sector. To learn more, visit www.publicconsultinggroup.com .PCG is seeking an AI Solutions Analyst to support the design, delivery, and ongoing monitoring of AI-enabled solutions within state government environments. This role bridges client-facing requirements work with hands-on responsibility for how the AI system actually performs — translating policy and program needs into structured requirements, and using evaluation data to diagnose and improve system output quality.The ideal candidate combines business analysis discipline with practical, hands-on fluency in enterprise AI — not just understanding how agentic workflows behave, but analyzing evaluation results with basic statistical reasoning and using that diagnosis to shape system behavior, within real-world constraints of performance, cost, and explainability.This role is ideal for candidates who want to work inside how enterprise AI environments by writing the requirements, measuring the results, and closing the gap between the two.What This Role Is NotNot a data science or ML infrastructure role (no model architecture, training pipelines, or platform engineering)Not a traditional business analyst role focused only on documentationNot a project manager role only owning delivery execution or sprint ceremoniesNot a prompt-only or AI tool usage role without enterprise context understandingNot a role where success is measured by prompt-writing volume — tuning here is diagnosis-led, grounded in evaluation data, not trial-and-error promptingKey ResponsibilitiesClient Engagement & Requirements FacilitationSupport and lead client requirements sessions and discovery discussionsTranslate policy and operational workflows into structured requirementsServe as a bridge between stakeholders and technical teamsAI Solution Design & TuningSupport design of AI-enabled solutions and define use casesDevelop and document AI workflowsDesign evaluation test sets with attention to sample size and representativeness across case types (LTC, ADB, etc.)Analyze evaluation results using basic statistical reasoning — error rates, false positive/negative patterns, distribution of failure modes — to identify where and why the system underperformsIterate on prompts and instructions to address root causes identified through evaluation analysisIdentify tradeoffs related to performance, cost, token usage, and explainabilityPartner with technical leads on tuning cycles within established review and sign-off processesDelivery & Operations SupportSupport broader program operations as needed — process design, cross-workstream coordination, and other work that helps scale delivery beyond a single engagementRequired QualificationsStrong communication skillsBachelor’s degree from an accredited institution4+ years of experience as a Business Analyst, Solutions Analyst, or ConsultantExperience translating complex needs into structured deliverablesClient-facing experience in requirements sessions and workshopsWorking knowledge of basic statistics — sample sizes, error rates, false positive/negative distinction, and comfort reading distributions — sufficient to design representative evaluation test sets and interpret resultsHands-on experience iterating on prompts/instructions for LLM-based systems in a production or near-production settingWorking knowledge of AI systems, including behavior, limitations, and agentic workflowsPractical understanding of model selection tradeoffs, context/cost constraints, and agentic workflow limitations beyond prompt-level interaction with frontier modelsTechnical understanding of system architecture, data flows, APIs, and integrationsPreferred QualificationsExperience supporting public-sector or compliance-driven programsFamiliarity with AI implementation patterns such as RAG and multi-agent workflowsExposure to cloud platforms (AWS Bedrock preferred, Azure acceptable)Familiarity with AI risks: bias, hallucination, explainabilityFamiliarity with compliance-driven delivery environments, including responsible AI practices, federal or state regulatory requirements, or structured governance frameworks#LI-MB1#LI-RemoteCompensation:Compensation for roles at Public Consulting Group varies depending on a wide array of factors including, but not limited to, the specific office location, role, skill set, and level of experience. As required by applicable law, PCG provides a reasonable range of compensation for this role. In addition, PCG provides a range of benefits for this role, including medical and dental care benefits, 401k, PTO, parental leave, bereavement leave.$100,00 - $120,000PCG does not sponsor newly hired foreign national workers for work authorization, including H-1B sponsorship.EEO Statement:Public Consulting Group is an Equal Opportunity Employer dedicated to celebrating diversity and intentionally creating a culture of inclusion. We believe that we work best when our employees feel empowered and accepted, and that starts by honoring each of our unique life experiences. At PCG, all aspects of employment regarding recruitment, hiring, training, promotion, compensation, benefits, transfers, layoffs, return from layoff, company-sponsored training, education, and social and recreational programs are based on merit, business needs, job requirements, and individual qualifications. We do not discriminate on the basis of race, color, religion or belief, national, social, or ethnic origin, sex, gender identity and/or expression, age, physical, mental, or sensory disability, sexual orientation, marital, civil union, or domestic partnership status, past or present military service, citizenship status, family medical history or genetic information, family or parental status, or any other status protected under federal, state, or local law. PCG will not tolerate discrimination or harassment based on any of these characteristics. PCG believes in health, equality, and prosperity for everyone so we can succeed in changing the ways the public sector, including health, education, technology and human services industries, work.