AI Design Evaluation Program Manager

United States Digital Space LLC; United States; Remote; USD 120,000 - 190,000; Full time

Job summary

United States Digital Space LLC is seeking a Design Program Manager, Evals to own the operating engine behind our design eval programs - the contractor and vendor operations, program rhythms, and quality standards that determine how fast and how well we can assess AI-generated design output.

You'll help set the quality and velocity bar across the entire eval pipeline and shape where our contractor and vendor investment goes.

Qualifications

• 3+ years of experience in design program management, DesignOps, or an adjacent design role.
• Deep craft expertise - you can speak to UI judgment and coach others on what good design looks like.
• Experience procuring, onboarding, and managing design contractors or third-party vendors.
• Experience driving operational programs that improve how teams work: rituals, processes, and documentation.
• Strong project management and written communication skills, including coordinating contractors and vendors across multiple time zones.

Responsibilities

• Drive quality and velocity across the design eval pipeline - running annotation rhythms, raising calibration and judgment standards, and closing the loop between eval output and product decisions
• Set the standard for high-quality reference designs so the eval pipeline has a reliable benchmark for what good looks like
• Own contractor hiring end to end: sourcing, screening, and closing - including the judgment call on when to scale headcount up or pull back based on eval demand
• Manage vendor logistics - budgets, SOWs, contracts, and purchasing - partnering with Legal, Security, and Procurement
• Run day-to-day program management for contractors and eval workstreams: status, blockers, timelines, and dependencies
• Partner with model designers to review contractor eval output and hold the quality bar
• Identify opportunities to automate or remove operational overhead across eval workstreams, including through internal tooling

Skills

Design program management

DesignOps

Project management

Vendor management

Written communication

Job description

United States Digital Space LLC is seeking a Design Program Manager, Evals to own the operating engine behind our design eval programs - the contractor and vendor operations, program rhythms, and quality standards that determine how fast and how well we can assess AI-generated design output.

You'll help set the quality and velocity bar across the entire eval pipeline and shape where our contractor and vendor investment goes.