Director, AI Evaluation & Quality

United States Digital Space LLC; United States; Remote; USD 180,000 - 280,000; Full time

Job summary

United States Digital Space LLC seeks a Director of Research - AI Evals to define how we measure AI-powered experiences across our products. You will build evaluation frameworks and quality bars that become the signals product teams rely on to ship.

Ideal candidates bring hands-on AI/LLM evaluation experience and strong cross‑functional collaboration, partnering with Product, Design, Engineering, and Data Science. This full-time role can be remote within the United States.

Qualifications

• Experience evaluating AI/LLM-powered products.
• Ability to blend human evaluation with automated approaches.
• Experience partnering with Product, Design, Engineering, and Data Science.

Responsibilities

• Define what 'good' means for AI features.
• Build the frameworks and quality bars to measure it.
• Turn evaluation results into trusted signals for product decisions.
• Collaborate with cross-functional teams to improve AI quality across products.

Job description

United States Digital Space LLC seeks a Director of Research - AI Evals to define how we measure AI-powered experiences across our products. You will build evaluation frameworks and quality bars that become the signals product teams rely on to ship.

Ideal candidates bring hands-on AI/LLM evaluation experience and strong cross‑functional collaboration, partnering with Product, Design, Engineering, and Data Science. This full-time role can be remote within the United States.