Sr. AI Data Analyst-Agentic Systems & GenAI

GM Financial; Fort Worth (TX); Hybrid; USD 90,000 - 125,000; Full time

Benefits offered by this job

401K matching

Tuition assistance

GM employee auto discount

Training opportunities

9 company holidays

Bonding leave for new parents

Job summary

GM Financial is seeking a Senior Data Analyst for Agentic AI & GenAI Delivery in the Fort Worth area. You will drive operational validation, deployment readiness, and data-driven optimization of AI systems, collaborating with AI/ML engineers and product teams.

The role emphasizes structured data analysis, observability, and business impact, with a hybrid work setup in Irving, TX or Fort Worth, TX. Bring 6–8 years in data analytics and strong SQL/Python skills.

Qualifications

• 6-8 years of experience in data analytics, data science, or AI systems analysis.
• Experience supporting AI/ML or GenAI systems in production environments.
• Auto finance experience preferred; cross-functional Agile team experience preferred.
• Bachelor’s or higher in a quantitative field; Master’s preferred.
• Advanced SQL and Python expertise.
• Experience with data visualization platforms (Power BI, Tableau).
• Familiarity with LLM workflows and prompt engineering, RAG pipelines, evaluation strategies.

Responsibilities

• Validate AI use cases align with real-world outcomes and monitor performance.
• Define data-driven validation frameworks for AI system performance and business impact.
• Develop dashboards, reports, and metrics to track AI deployments.
• Collaborate with architects and engineers to ensure feasibility and design alignment.
• Monitor production AI systems for anomalies, failures, and hallucinations.
• Provide executive-level reporting on AI system effectiveness.
• Translate technical findings into clear business insights.

Skills

SQL

Python

Power BI

Tableau

Azure OpenAI

LLM workflows

Education

Bachelor’s in Data Science

Master’s degree preferred

Tools

Azure Databricks

Cosmos DB

Log Analytics

Application Insights

Job description

Job Description

Innovation isn’t just a talking point at GM Financial; it’s how we operate. From generative AI and cloud-native technologies to peer‑led learning and hackathons, our tech teams are building real solutions that make a difference. We’re committed to AI‑powered transformation, using advanced machine learning and automation to reimagine customer interactions and modernize operations, positioning GM Financial as a leader in digital innovation within a dynamic industry. Join us and discover a workplace where your ideas matter, your development is prioritized, and you can truly make a global impact.

Responsibilities

The Senior Data Analyst – Agentic AI & GenAI Delivery plays a critical role in operationalizing and scaling Agentic AI solutions across the enterprise. This role focuses on driving delivery, deployment validation, and continuous optimization of AI systems through data‑driven insights, validation frameworks, and reporting mechanisms.

• Validate that AI use cases align with real‑world outcomes.
• Monitor agent behavior, performance, and reliability.
• Establish data‑driven feedback loops for continuous improvement.
• Validate readiness of Agentic AI use cases for production deployment.
• Track deployment success metrics and post‑production performance.
• Identify gaps between expected vs. actual outcomes.
• Define metrics for accuracy and response quality; task completion success rates; hallucination and failure cases; latency and throughput.
• Build evaluation datasets and validation pipelines.
• Analyze agent workflows and decisions, prompt‑response chains, tool usage and orchestration behavior.
• Develop observability dashboards using telemetry and logs.
• Detect and escalate production issues and anomalies.
• Perform root cause analysis on failures and performance issues.
• Deliver executive‑level reporting on AI system effectiveness.
• Provide actionable insights to improve system design and outcomes.
• Work closely with lead architects, AI/ML engineers, and product teams to align feasibility and design.
• Translate technical findings into clear business insights.
• Advanced SQL, Python (Pandas, NumPy), or similar tools; data visualization platforms (Power BI, Tableau).

In This Role You Will

• Drive the delivery and operational validation of Agentic AI solutions through structured data analysis and reporting.
• Define and implement data‑driven validation frameworks to evaluate AI system performance, accuracy, reliability, and business impact.
• Analyze production data from AI systems (agents, workflows, prompts, responses) to identify trends, issues, and optimization opportunities.
• Develop dashboards, reports, and metrics to track the health and effectiveness of Agentic AI deployments.
• Partner with architecture and engineering teams to validate feasibility outcomes and ensure solutions align with real‑world system behavior.
• Monitor AI systems in production, identifying anomalies, failure patterns, hallucinations, and performance degradation.
• Support deployment efforts by validating readiness criteria, including performance thresholds, guardrails, and compliance requirements.
• Enable continuous improvement loops by feeding insights back into model tuning, prompt design, and system architecture.
• Support A/B testing and experimentation for AI workflows and use cases.
• Collaborate with business stakeholders to measure and report on AI‑driven business outcomes and ROI.
• Ensure transparency and traceability of AI decisions through structured logging, trace analysis, and reporting.
• Contribute to the development of AI observability frameworks, including metrics, KPIs, and alerting strategies.

Qualifications

• 6-8 years experience in data analytics, data science, or AI systems analysis.
• Experience supporting AI/ML or GenAI systems in production environments.
• Auto finance experience preferred; cross‑functional Agile team experience preferred.
• Bachelor’s Degree in Data Science, Computer Science, Engineering or related quantitative field; Master’s Degree preferred.
• Advanced SQL and Python expertise.
• Experience with data visualization platforms (Power BI, Tableau).
• Strong experience in data validation, anomaly detection, and statistical analysis.
• Familiarity with LLM workflows and prompt engineering, RAG pipelines, evaluation strategies, agent orchestration.
• Understanding of AI failure modes (hallucinations, drift, inconsistency).
• Experience with logging, tracing, telemetry, AI evaluation tools, and monitoring production systems.
• Strong knowledge of Azure ecosystem: Azure OpenAI, Azure Databricks, Azure SQL, Cosmos DB, Log Analytics, Application Insights.
• Excellent analytical, problem‑solving, and communication skills.
• Ability to translate data into actionable insights and connect system behavior with business outcomes.
• High attention to detail in validation, quality, and accuracy.
• Ability to thrive in fast‑evolving AI environments and manage large structured and unstructured datasets.

Work Experience & Education

• 6-8 years experience in data analytics, data science, or AI systems analysis.
• Experience supporting AI/ML or GenAI systems in production environments.
• Auto finance experience preferred; cross‑functional Agile team experience preferred.
• Bachelor’s Degree in Data Science, Computer Science, Engineering or related quantitative field; Master’s Degree preferred.

What We Offer

Generous benefits package available on day one, including 401K matching, bonding leave for new parents (12 weeks, 100% paid), tuition assistance, training, GM employee auto discount, community service pay, and nine company holidays.

Our Culture

Our team members define and shape our culture — an environment that welcomes innovative ideas, fosters integrity, and creates a sense of community and belonging. Here we do more than work — we thrive.

Compensation

Competitive pay and bonus eligibility.

Work Life Balance

Hybrid work environment, 2 days a week in office. The office locations for this role can be Irving, TX or Ft. Worth, TX.

NOTE

We are unable to consider candidates who require visa sponsorship for this position.

This position is not open to agency submissions.