Information Designer II: 26-03441

Akraya Inc.

Mountain View (CA)

Hybrid

USD 62,000 - 69,000

Full time

3 days ago
Be an early applicant

Get a reply from this recruiter

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Akraya is seeking a seasoned Senior Conversation Designer to enhance AI-powered chatbots and voice assistants. You will craft conversational experiences, curate golden datasets, and evaluate AI responses at scale to drive improvements in accuracy and customer satisfaction.

Required 8+ years in design with 4+ years in Conversation Design, plus 1+ year on AI agentic platforms. Hybrid Mountain View location, 12-month contract, pay $45–$50 per hour on W2.

Qualifications

  • Design conversation strategies, principles, and playbooks for AI-powered products.
  • Build AI skills using Claude Code or similar tools to generate golden datasets.
  • Evaluate AI responses using LLM-as-a-Judge models and human feedback.
  • Analyze AI answer quality, accuracy, and customer experience trends.
  • Partner with Engineering and Data Science teams to drive improvements.
  • Must have 8+ years of design experience, including 4+ years in Conversation Design.
  • Must have 1+ year of experience with AI agentic platforms.
  • Strong expertise in prompt engineering, AI tools, and data analysis.
  • Understanding of LLMs, NLP/NLU, RAG, or machine learning frameworks.
  • Working knowledge of Python, HTML, XML, Regex, or similar coding languages.

Responsibilities

  • Design conversation strategies, principles, and playbooks for AI-powered products.
  • Build AI skills using Claude Code or similar tools to generate golden datasets.
  • Evaluate AI responses using LLM-as-a-Judge models and human feedback.
  • Analyze AI answer quality, accuracy, and customer experience trends.
  • Partner with Engineering and Data Science teams to drive improvements.

Skills

Conversation Design
AI Evaluations & Golden Datasets
Prompt Engineering
Data Analysis
AI Agentic Platforms

Tools

Python
HTML
XML
Regex

Job description

Primary Skills: Conversation Design (advanced), AI Evaluations & Golden Datasets (advanced), Prompt Engineering (advanced), Data Analysis (advanced), AI Agentic Platforms (intermediate)

Contract Type: W2 Only

Location: Mountain View, CA (#Hybrid)

Duration: 12 months

Pay Range: $45-$50 Per Hour on W2

JOB SUMMARY

This role focuses on improving the quality and accuracy of AI-powered chatbots and voice assistants. You will design conversational experiences, build golden datasets, evaluate AI-generated responses at scale, and provide insights to improve AI performance.

JOB REQUIREMENTS
  • Design conversation strategies, principles, and playbooks for AI-powered products.
  • Build AI skills using Claude Code or similar tools to generate golden datasets.
  • Evaluate AI responses using LLM-as-a-Judge models and human feedback.
  • Analyze AI answer quality, accuracy, and customer experience trends.
  • Partner with Engineering and Data Science teams to drive improvements.
  • Must have 8+ years of design experience, including 4+ years in Conversation Design.
  • Must have 1+ year of experience with AI agentic platforms.
  • Strong expertise in prompt engineering, AI tools, and data analysis.
  • Understanding of LLMs, NLP/NLU, RAG, or machine learning frameworks.
  • Working knowledge of Python, HTML, XML, Regex, or similar coding languages.
INDUSTRY EXPERIENCE

Experience in conversational AI, chatbots, voice assistants, AI evaluation, or generative AI products is preferred.

ABOUT AKRAYA

Akraya is an award-winning IT staffing firm consistently recognized for our commitment to excellence and a thriving work environment. Most recently, we were recognized Inc's Best Workplaces 2024 and Silicon Valley's Best Places to Work by the San Francisco Business Journal (2024) and Glassdoor's Best Places to Work (2023 & 2022)!

Industry Leaders in IT Staffing As staffing solutions providers for Fortune 100 companies, Akraya's industry recognitions solidify our leadership position in the IT staffing space.

We don't just connect you with great jobs, we connect you with a workplace that inspires!

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Lead Conversation Designer for AI Quality & Golden Datasets
Lead Conversation Designer for AI Quality & Golden Datasets

Akraya Inc. • Mountain View (CA)

Hybrid
USD 62,000 - 69,000
AI Output Evaluator: 26-03373
AI Output Evaluator: 26-03373

Akraya Inc. • San Francisco (CA)

Remote
USD 62,000 - 69,000
Project/Program Manager II: 26-03380
Project/Program Manager II: 26-03380

Akraya Inc. • Seattle (WA)

On-site
USD 103,000 - 107,000
Communications Specialist III: 26-03412
Communications Specialist III: 26-03412

Akraya Inc. • San Diego (CA)

Remote
USD 69,000 - 74,000
Software Engineer AI Evaluation & Automation : 26-02760
Software Engineer AI Evaluation & Automation : 26-02760

Akraya • San Diego (CA)

Remote
USD 90,000 - 101,000
UX Engineer: 26-01672
UX Engineer: 26-01672

Akraya Inc. • New York (NY)

Remote
USD 96,000 - 110,000
Conversational AI / NLP Specialist III
Conversational AI / NLP Specialist III

Crystal Equation Corporation • Menlo Park (CA)

Remote
USD 110,000 - 117,000
Paid time off
Medical insurance
Dental insurance
+4
Data Engineer II: 26-02829
Data Engineer II: 26-02829

Akraya • California

Hybrid
USD 76,000 - 90,000
Sr. Conversational AI Designer
Sr. Conversational AI Designer

TEKsystems • United States

Remote
USD 110,000 - 131,000
Medical, dental & vision
401(k) Retirement Plan
Life Insurance
+4
AI Engineer – DHS
AI Engineer – DHS

Brooksource • Nashville (TN)

Remote
USD 96,000 - 110,000