Remote AI Analytics Lead – AI Performance & Insights

National Debt Relief; Idaho; A distancia; USD 140.000 - 160.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Medical, Dental, and Vision Benefits

401(k) with Company Match

Paid Holidays, Volunteer Time Off, and

Vacation

Paid Parental Leave

Pre-tax Transit Benefits

No-Cost Life Insurance Benefits

Wellness Incentive Program

ASPCA Pet Health Insurance Discount

Descripción de la vacante

National Debt Relief is seeking a data-savvy Manager of AI Analytics to lead analytical work measuring and optimizing agent-replacement AI across voice and chat. You will design tests, track KPIs, and build dashboards for real-time visibility into AI performance against quality and client experience goals.

You will partner with AI Analytics and Engineering teams to translate complex model data into actionable recommendations, guiding AI scale-up decisions and ensuring data quality across

Formación

• Bachelor's degree in Business, Economics, Data Science, or related field.
• 6 years of experience in analytics, business intelligence, or similar roles.
• Experience in financial services or fintech, especially client onboarding or customer support journeys preferred.
• Previous exposure to leading or mentoring junior analysts, even without formal management experience preferred.

Responsabilidades

• Execute the measurement framework for AI Analytics, tracking performance of agent-replacement AI interactions across voice and chat channels.
• Design and run test analysis for AI model and prompt experiments (e.g., model version A/B tests, containment vs. escalation testing), translating results into go/no-go recommendations.
• Build and maintain dashboards and scorecards tracking AI-handled interaction KPIs — containment rate, accuracy, quality/CSAT, and escalation rate.
• Partner with AI Analytics and Engineering teams to ensure AI interaction data (transcripts, model outputs, outcomes) flows cleanly into unified reporting.
• Analyze AI-handled interaction volume and performance trends to support decisions on scaling AI across channels, balancing performance thresholds and client experience.
• Collaborate with data engineering to validate and maintain data flows into Snowflake for AI analytics use cases.
• Communicate findings and recommendations clearly to both technical and non-technical stakeholders, including Analytics leadership.
• Identify data quality issues or gaps in AI interaction tracking and drive resolution with cross-functional partners.
• Stay current on conversational AI/LLM measurement practices and evolving best practices in AI performance analytics.

Conocimientos

SQL

Data modeling

AI analytics

A/B testing

Communication

Cross-functional collaboration

Mentoring junior analysts

Fintech domain knowledge

Educación

Bachelor's degree in Business, Economics, Data Science, or related field

Herramientas

Snowflake

Tableau

Sigma

Looker

Power BI

Python

BigQuery ML

Airflow

Segment

mParticle

Descripción del empleo

National Debt Relief is seeking a data-savvy Manager of AI Analytics to lead analytical work measuring and optimizing agent-replacement AI across voice and chat. You will design tests, track KPIs, and build dashboards for real-time visibility into AI performance against quality and client experience goals.

You will partner with AI Analytics and Engineering teams to translate complex model data into actionable recommendations, guiding AI scale-up decisions and ensuring data quality across