AI Behavioral Scientist

101 Extreme Networks, Inc.; United States; On-site; USD 120,000 - 170,000; Full time

Job summary

Extreme Networks, Inc. in Austin, TX is seeking an AI Behavioral Scientist to evaluate AI agents and study user interactions across usability, reliability, and trust metrics. You will design studies, apply human-computer interaction frameworks, and translate findings into actionable product insights.

You will partner with product, engineering, and design teams to define experiments, build dashboards, and communicate behavioral analytics to leadership. Rolling applications, visa not sponsored.

Qualifications

• Experience evaluating AI systems, ML models, chatbots, or autonomous agents.
• 4+ years in user analytics, product analytics, behavioral research, or HCI research.
• Strong foundation in HCI and behavioral science (cognitive load, mental models, task completion, user trust).
• Proficiency with quantitative analytics: SQL, Python/R, with familiarity with A/B testing and experimental design.
• Experience designing and instrumenting analytics tracking and interpreting data.
• Systemic thinking about product performance and interactions between variables.

Responsibilities

• AI Agent evaluation & behavioral analysis across usability, task completion, error recovery, and user satisfaction.
• Analytics & quantitative research: track KPIs, cohort analysis, A/B testing, and data collection.
• Systems-level performance: assess accuracy, latency, cost, scalability, and trade-offs.
• Product insights & strategy: translate findings into roadmap priorities and communicate with stakeholders.

Skills

AI systems evaluation

User analytics

HCI principles

Quantitative analytics (SQL/Python/R)

Experiment design (A/B testing)

Education

Graduate degree in psychology, HCI, behavioral science, statistics, or related field

Tools

SQL

Python

R

Amplitude

Mixpanel

Looker

Tableau

Snowflake

dbt

Job description

About Extreme Networks

Over 50,000 customers globally trust our end-to-end, cloud-driven networking solutions. They rely on our top-rated services and support to accelerate their digital transformation efforts and deliver unprecedented progress. With double-digit growth year over year, no provider is better positioned to deliver scalable outcomes than Extreme. Inclusion is one of our core values and in our DNA. We are committed to fostering an inclusive workplace that embraces our differences and creates an atmosphere where all our employees thrive because of their differences, not in spite of them. Become part of Something big with Extreme! As a global networking leader, learn why there's no better time to join the Extreme team.

Job Description

What you will do (Job Specific Details on the nature of the job and responsibilities).

Position Details

Title of position: AI Behavioral Scientist
Position type: Full time
Location: Austin, TX
Position reports to: Senior Director AI Product Foundations Engineering
Application deadline: Applications are being accepted on a rolling basis and this posting will remain open until filled.
Work authorization: We are unable to sponsor or take over sponsorship of an employment visa, including H1B visas, at this time

Primary Responsibilities

• AI Agent Evaluation & Behavioral Analysis
  • Design and conduct comprehensive behavioral studies to evaluate AI agent performance across usability, task completion, error recovery, and user satisfaction metrics
  • Apply HCI and behavioral science frameworks to understand how users interact with AI systems and identify friction points in agent behavior
  • Assess agent reliability, decision transparency, and failure modes from both user and systems perspectives
• Analytics & Quantitative Research
  • Develop user analytics frameworks to track AI agent effectiveness, including KPIs for success, user trust, task completion rates, and cognitive load
  • Design and implement instrumentation to collect behavioral and interaction data from user sessions
  • Conduct statistical analysis, A/B testing, and cohort analysis to measure AI agent impact and validate product improvements
• Systems-Level Performance Assessment
  • Evaluate AI agents holistically across performance dimensions: accuracy, latency, cost efficiency, scalability, and robustness
  • Model and communicate trade-offs between performance dimensions (e.g., accuracy vs speed, cost vs quality)
  • Identify bottlenecks and systemic issues affecting user experience across the full AI-user interaction lifecycle
• Product Insights & Strategy
  • Translate behavioral findings and analytics into actionable product recommendations and roadmap priorities
  • Partner with product managers, engineers, and designers to validate hypotheses and guide feature development
  • Create dashboards, reports, and narratives to communicate behavioral insights to stakeholders and leadership

Required Qualifications

• Prior experience evaluating AI systems, machine learning models, chatbots, or autonomous agents
• 4+ years of professional experience in user analytics, product analytics, behavioral research, or HCI research roles
• Strong foundation in human-computer interaction (HCI) principles and behavioral science fundamentals (cognitive load, mental models, task completion, user trust, etc.)
• Demonstrated proficiency with quantitative analytics: SQL, Python/R for statistical analysis, and familiarity with A/B testing and experimental design
• Experience designing and instrumenting analytics tracking, defining success metrics, and interpreting complex datasets
• Ability to think systemically about product performance and understand interactions between multiple variables affecting user outcomes
• Excellent communication skills with ability to translate technical findings into clear, compelling narratives for non-technical stakeholders

Preferred Qualifications

• Background in formal usability testing, user research, or user testing methodologies (or equivalent research experience)
• Experience with analytics platforms (Amplitude, Mixpanel, Looker, Tableau) or BI tools
• Familiarity with systems thinking frameworks, causal inference, or econometric modeling
• Experience collaborating with ML/AI engineers or understanding of AI/ML capabilities and limitations
• Graduate degree in psychology, HCI, behavioral science, statistics, or related field
• Experience measuring LLM or conversational-AI systems - evaluation signals such as latency, refusal/quality scoring, or conversation-trajectory classification
• Familiarity with networking, IT operations, or B2B SaaS, and with operational KPIs like MTTR, uptime, or escalation rate
• Experience with a modern data stack (Snowflake, dbt) and light scripting in Python or R
• Exposure to NPS, SUS, or other structured voice-of-customer programs; comfort with sentiment/theme analysis of free-text feedback

Key Competencies

• Analytical Thinking: Ability to break down complex problems, identify patterns, and derive insights from data
• User Empathy: Deep understanding of user needs, motivations, and behavioral patterns; ability to advocate for user-centric design
• Systems Thinking: Comfort working with interconnected systems and understanding emergent behavior and trade-offs
• Curiosity: Passion for understanding how and why users interact with technology; willingness to challenge assumptions
• Communication: Ability to translate complex behavioral and technical findings into accessible insights for diverse audiences
• Collaboration: Ability to work cross-functionally with product, engineering, and design teams to drive product improvements

Equal Employment Opportunity

Extreme Networks, Inc. is an Equal Opportunity Employer. Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran. We are committed to taking affirmative action to employ and advance in employment qualified protected veterans, including disabled veterans, recently separated veterans, active-duty wartime or campaign badge veterans, and Armed Forces service medal veterans. Extreme Networks also strives to prevent other, subtler forms of inappropriate behavior (for example, stereotyping) from ever gaining a foothold in our organization. Whether blatant or hidden, barriers to success have no place at Extreme Networks. We encourage people from underrepresented groups to apply.

Fair chance and background checks

Extreme Networks will consider qualified applicants with criminal histories in a manner consistent with the California Fair Chance Act, Los Angeles Fair Chance Initiative for Hiring Ordinance, Los Angeles County Fair Chance Ordinance for Employers, Philadelphia Fair Criminal Record Screening Standards Ordinance, Illinois Human Rights Act, Cook County Human Rights Ordinance, Seattle Fair Chance Employment Ordinance, and the San Francisco Fair Chance Ordinance. An applicant's conviction history will not be considered until after a conditional offer of employment has been made. Following any individualized assessment, applicants will be provided with the opportunity to respond before any adverse action is taken. Extreme Networks does not seek salary history information from applicants and will not rely on salary history in determining whether to offer employment or in setting compensation.

Job Description Summary Qualifications

Basic Requirements and Preferred Qualifications for the job. We encourage people from underrepresented groups to apply. Come Advance with us! In keeping with our values, no employee or applicant will face discrimination/harassment based on: race, color, ancestry, national origin, religion, age, gender, marital domestic partner status, sexual orientation, gender identity, disability status, or veteran status. Above and beyond discrimination/harassment based on "protected categories," Extreme Networks also strives to prevent other, subtler forms of inappropriate behavior (e.g., stereotyping) from ever gaining a foothold in our organization. Whether blatant or hidden, barriers to success have no place at Extreme Networks. We may use artificial intelligence (AI) tools to support parts of the hiring process, such as reviewing applications, analyzing resumes, or assessing responses. These tools assist our recruitment team but do not replace human oversight. Final hiring decisions are ultimately made by humans. If you would like more information about how your data is processed -or to exercise any applicable privacy rights—please contact us at [e-mail]. Our full privacy statement is available here: Privacy Statement

Company Overview

Over 50,000 customers globally trust our end-to-end, cloud-driven networking solutions. They rely on our top-rated services and support to accelerate their digital transformation efforts and deliver unprecedented progress. With double-digit growth year over year, no provider is better positioned to deliver scalable outcomes than Extreme. Inclusion is one of our core values and in our DNA. We are committed to fostering an inclusive workplace that embraces our differences and creates an atmosphere where all our employees thrive because of their differences, not in spite of them. Become part of Something big with Extreme! As a global networking leader, learn why there's no better time to join the Extreme team.