Lead Conversation Designer for AI Quality & Golden Datasets

Akraya Inc.

Mountain View (CA)

Hybrid

USD 62,000 - 69,000

Full time

3 days ago
Be an early applicant

Get a reply from this recruiter

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Akraya is seeking a seasoned Senior Conversation Designer to enhance AI-powered chatbots and voice assistants. You will craft conversational experiences, curate golden datasets, and evaluate AI responses at scale to drive improvements in accuracy and customer satisfaction.

Required 8+ years in design with 4+ years in Conversation Design, plus 1+ year on AI agentic platforms. Hybrid Mountain View location, 12-month contract, pay $45–$50 per hour on W2.

Qualifications

  • Design conversation strategies, principles, and playbooks for AI-powered products.
  • Build AI skills using Claude Code or similar tools to generate golden datasets.
  • Evaluate AI responses using LLM-as-a-Judge models and human feedback.
  • Analyze AI answer quality, accuracy, and customer experience trends.
  • Partner with Engineering and Data Science teams to drive improvements.
  • Must have 8+ years of design experience, including 4+ years in Conversation Design.
  • Must have 1+ year of experience with AI agentic platforms.
  • Strong expertise in prompt engineering, AI tools, and data analysis.
  • Understanding of LLMs, NLP/NLU, RAG, or machine learning frameworks.
  • Working knowledge of Python, HTML, XML, Regex, or similar coding languages.

Responsibilities

  • Design conversation strategies, principles, and playbooks for AI-powered products.
  • Build AI skills using Claude Code or similar tools to generate golden datasets.
  • Evaluate AI responses using LLM-as-a-Judge models and human feedback.
  • Analyze AI answer quality, accuracy, and customer experience trends.
  • Partner with Engineering and Data Science teams to drive improvements.

Skills

Conversation Design
AI Evaluations & Golden Datasets
Prompt Engineering
Data Analysis
AI Agentic Platforms

Tools

Python
HTML
XML
Regex

Job description

Akraya is seeking a seasoned Senior Conversation Designer to enhance AI-powered chatbots and voice assistants. You will craft conversational experiences, curate golden datasets, and evaluate AI responses at scale to drive improvements in accuracy and customer satisfaction.

Required 8+ years in design with 4+ years in Conversation Design, plus 1+ year on AI agentic platforms. Hybrid Mountain View location, 12-month contract, pay $45–$50 per hour on W2.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Information Designer II: 26-03441
Information Designer II: 26-03441

Akraya Inc. • Mountain View (CA)

Hybrid
USD 62,000 - 69,000
Senior Conversation Designer for AI Voice & Multichannel
Senior Conversation Designer for AI Voice & Multichannel

Decagon • San Francisco (CA)

On-site
USD 160,000 - 200,000
Medical, Dental, Vision
Life Insurance
401K/Pension
+5
Senior Conversation Designer – Voice & AI for Enterprise
Senior Conversation Designer – Voice & AI for Enterprise

Decagon • United States

Remote
USD 160,000 - 200,000
Vacation policy
Medical benefits
Life Insurance
+4
Senior Conversational AI Designer
Senior Conversational AI Designer

Veriipro • Eden Prairie (MN)

On-site
USD 120,000 - 160,000
Senior Conversational Designer — Voice & GenAI
Senior Conversational Designer — Voice & GenAI

Slang • New York (NY)

Hybrid
USD 160,000 - 180,000
Senior Conversation Designer — AI Voice & Chat (Hybrid NYC)
Senior Conversation Designer — AI Voice & Chat (Hybrid NYC)

Slang AI • New York (NY)

Hybrid
USD 155,000 - 198,000
Hybrid work
Equity
Health insurance
+1
Remote Lead Conversational AI Designer
Remote Lead Conversational AI Designer

TEKsystems • United States

Remote
USD 110,000 - 131,000
Medical, dental & vision
401(k) Retirement Plan
Life Insurance
+4
AI Chatbot Quality Designer (Remote)
AI Chatbot Quality Designer (Remote)

Catapult Solutions Group • United States

Remote
USD 57,000 - 82,000
Remote Senior Conversational AI Designer
Remote Senior Conversational AI Designer

TEKsystems • Minneapolis (MN)

Remote
USD 110,000 - 131,000
Senior Conversational Designer
Senior Conversational Designer

H & A Resources, LLC • Atlanta (GA)

Remote
USD 89,544 - 96,432