Data Analyst, AI Agent Analytics — New Grad

re-zoo-me; Santa Clara (CA); Hybrid; USD 85,000 - 115,000; Full time

Job summary

Jobright is seeking a New Grad Data Analyst focused on AI Agent Analytics to measure agent quality, analyze user interactions, and turn data into insights that improve our AI systems.

You will define metrics, build dashboards, and support experiments across prompts, models, and tools, collaborating with AI and product teams to drive meaningful improvements.

Qualifications

• Recent graduate in Data Science, Statistics, Computer Science, Mathematics, Economics, or a related field.
• Strong SQL skills and familiarity with Python.
• Understanding of statistics, experimentation, and data visualization.
• Strong analytical and communication skills.
• Ability to work effectively in a remote environment.

Responsibilities

• Define metrics for agent task completion, quality, latency, reliability, and cost.
• Analyze agent conversations, tool usage, errors, and user feedback.
• Build SQL queries, dashboards, and recurring reports.
• Identify failure patterns and improvement opportunities.
• Support experiments involving prompts, models, tools, and workflows.
• Present actionable recommendations to AI and product teams.

Skills

SQL

Python

Statistics

Experimentation

Data visualization

Analytical thinking

Communication

Remote work

Education

Recent graduate in Data Science, Statistics, Computer Science, Mathematics, Economics, or a related field

Tools

Pandas

Tableau

Looker

Job description

Jobright is your personal AI job search agent that transforms the way you do job search from solo, time-consuming efforts to a fast, expert-guided journey, simplifying every job search step and accelerating your route to the best job outcomes. As a New Grad Data Analyst focused on AI Agent Analytics, you will measure agent quality, understand user interactions, and turn complex behavioral data into insights that improve our AI systems.

Why Join Us

• Build real, production AI agents used by real users
• High ownership and impact
• Work at the intersection of AI, agents, and product
• Shape how people experience AI-driven job search

Responsibilities

• Define metrics for agent task completion, quality, latency, reliability, and cost
• Analyze agent conversations, tool usage, errors, and user feedback
• Build SQL queries, dashboards, and recurring reports
• Identify failure patterns and improvement opportunities
• Support experiments involving prompts, models, tools, and workflows
• Present actionable recommendations to AI and product teams

Qualification

Required

• Recent graduate in Data Science, Statistics, Computer Science, Mathematics, Economics, or a related field
• Strong SQL skills and familiarity with Python
• Understanding of statistics, experimentation, and data visualization
• Strong analytical and communication skills
• Ability to work effectively in a remote environment

Preferred

• Experience analyzing LLM, chatbot, or agent interactions
• Familiarity with product analytics or event-tracking systems
• Experience with pandas, Tableau, Looker, or similar tools
• Interest in AI evaluation, prompt engineering, or human-AI interaction