AI & Conversational Analytics Specialist

Accenture Federal Services; Washington (District of Columbia); On-site; USD 100,000 - 203,000; Full time

Job summary

Accenture Federal Services seeks a data analytics professional to optimize AI-driven chatbot performance across defense and civilian government programs. You will analyze metrics, monitor LLM performance, and run A/B tests to improve prompts, responses, and user experience.

You will design end-to-end AI deployment workflows, build dashboards, and produce executive reports highlighting ROI and contact center impact while ensuring Responsible AI and data quality standards.

Qualifications

• US Citizen (Public Trust eligible).
• Strong data analysis skills: SQL and Python.
• Working understanding of AI/ML concepts: LLMs, prompt engineering, model evaluation metrics, NLP fundamentals.
• Experience with BI/visualization tools: Databricks, Splunk, Tableau, PowerBI, or similar.
• Knowledge of conversational AI, chatbot analytics, and customer experience metrics.
• Ability to communicate complex technical findings clearly and translate insights into executive-ready recommendations.
• Preferred: hands-on GenAI chatbot analytics for high-volume environments (1M+ monthly users).
• Direct involvement in LLM performance monitoring, guardrail testing, or RAG evaluation.
• Prior work optimizing AI operational workflows such as model deployment or incident response.

Responsibilities

• Analyze chatbot performance metrics such as user satisfaction, deflection rates, response accuracy, latency, and token usage.
• Monitor LLM model performance to detect quality issues, edge cases, and opportunities for prompt or response optimization.
• Perform deep-dive analyses on user feedback, conversation patterns, and intent classification to improve the product.
• Design and execute A/B tests to measure the impact of new features, prompt changes, and model configurations.
• Manage and optimize end-to-end workflows for model deployment, monitoring, and incident response.
• Build automated alerting systems for operational metrics, SLAs, and AI performance thresholds.
• Coordinate cross-functional workflows across data science, engineering, product, and business teams.
• Identify and resolve data quality issues, pipeline bottlenecks, and system inefficiencies through root cause analysis.
• Create and maintain dashboards in SQL, Python, and BI tools (Databricks, Splunk, Dynatrace).
• Develop executive-level reports on chatbot performance, user trends, ROI, and contact center impact.
• Build data documentation, metadata standards, and analytics playbooks for stakeholder self-service.
• Track and report KPIs such as user engagement, task completion, escalation patterns, and cost per interaction.

Skills

SQL

Python

Data analytics

AI/ML concepts

NLP fundamentals

Executive communication

Tools

Databricks

Splunk

Dynatrace

Tableau

PowerBI

Job description

Accenture Federal Services seeks a data analytics professional to optimize AI-driven chatbot performance across defense and civilian government programs. You will analyze metrics, monitor LLM performance, and run A/B tests to improve prompts, responses, and user experience.

You will design end-to-end AI deployment workflows, build dashboards, and produce executive reports highlighting ROI and contact center impact while ensuring Responsible AI and data quality standards.