AI Quality Analyst II — Elevate Advisor Workflows

United States Digital Space LLC

United States

Remote

USD 70,000 - 100,000

Full time

14 days+

Get more replies from employers

Send a job-specific resume in minutes.

Job summary

United States Digital Space LLC is seeking a Quality Analyst II to join Customer Success — Programs & AI Innovation as an evaluator-first specialist focused on the quality of AI-powered workflows that support advisors before, during and after every customer call. You will evaluate AI outputs across ORA, refine prompts, update knowledge bases and document issues to feed improvements.

This is a growth-oriented role with escalating responsibilities and close collaboration with engineering and

Qualifications

2+ years of experience in Quality Assurance, Customer Support, AI evaluation or a related role
Understanding of how LLMs behave — prompt design, failure modes and AI patterns
Ability to follow structured guidelines and scoring rubrics consistently
Comfort reading code and making minor edits to follow integrations and iterate inside ORA

Responsibilities

Evaluate AI quality across the advisor stack and surface what is working, what is broken and where to raise the bar
Iterate inside ORA — refine prompts, update knowledge bases, tweak skills and test changes
Surface trends and drive continuous improvement with clear classifications and reports
Partner with RevOps Engineering and Lead Analyst to implement platform changes and end-to-end designs
Stay sharp through ongoing learning and sharing findings with the team