A complete application in a minute
Tailored resume and cover letter, ready to send.
Catapult Solutions Group is seeking a Conversation Designer for an all-remote contract role (US, Pacific Time hours) focused on AI chatbot evaluations. You will build datasets, review responses, and score quality against rubrics, collaborating with product, engineering and data science teams.
The ideal candidate has 3–5 years in conversation design, strong analytical skills, and comfort using AI tools. This role offers a 12‑month contract with remote work from anywhere in the US.
Location: 100% Remote (US) - must work Pacific Time business hours
Role Type: Contract, 12 months (W-2)
Our client is a global financial technology company, headquartered in the San Francisco Bay Area. Its tax, accounting, personal finance and marketing products serve roughly 100 million consumers and small businesses worldwide, and its small-business accounting platform is one of the most widely used in the US. Over the past few years, the company has been transforming into an AI-driven platform, building generative-AI assistants and agents into its products. Its mission is to power prosperity around the world, and it has a reputation for customer obsession, innovation and a strong engineering and design culture.
Our client's small-business platform includes an AI chatbot, built on a leading large language model and extended with company-specific skills and agents, that helps business owners get answers and complete tasks in the product. As more customers rely on it, making sure every answer is accurate, relevant and on-brand is critical. That's why the team is adding three Conversation Designers focused on AI chatbot evaluation and quality.
In this role, you'll build the question-and-answer datasets used to test the chatbot, review and score its responses against approved source content and quality rubrics, and track accuracy over time. When quality drops in an area, you'll dig in, find the pattern behind the errors and give Engineering clear, actionable feedback. You'll work closely with conversation designers, product managers, engineers and data scientists on the conversational AI team.
This is not a visual UX/UI design role and not a software engineering role, and no Python or coding is required. It's ideal for an analytical, detail-oriented person who loves AI, enjoys figuring out why a chatbot got something wrong, and uses AI tools (such as Claude Code or ChatGPT) to work faster and smarter.
Bachelor's degree preferred (e.g., HCI, Interaction Design, Linguistics, Psychology, Computer Science or a related field), or equivalent practical experience.
Love AI and have a sharp eye for when a chatbot gets it wrong? Work from the comfort of your home and help shape the quality of an AI assistant used by millions.
Conversation Designer | Conversational AI | Chatbot | LLM Evaluation | AI Evaluation | AI Quality Analyst | Prompt Engineering | Generative AI | Remote