AI Data Evaluations Lead - Proposals & Pilots (Remote)

Anyone AI Inc.; United States; Remote; USD 120,000 - 170,000; Full time

Job summary

Anyone AI Inc. is seeking a senior professional to own data initiatives and proposals for AI labs, from initial data proposals to pilot delivery.

You will shape frontier-grade sample packages across reasoning, coding, agents, and tools, collaborating with experts to ensure ground truth and enterprise-grade quality. This role sits at the operational center of the Human Data Division on a remote, international team.

Qualifications

• 5+ years in technical delivery, quality, or program management.
• Hands-on experience delivering data or evaluation work to AI labs or enterprise ML teams.
• Fluent understanding of frontier model evaluation: benchmarks, rubrics, headroom, and discriminative tasks.
• Proven people/vendor leadership, recruiting and maintaining a quality expert pool.
• Fluent English; Spanish is a nice to have.

Responsibilities

• Proposals & requests: Study public benchmarks and eval targets, turn them into proposals and sample packages.
• Sample & benchmark development: Design and build sample packages with SME input to meet our standards.
• Subject-matter experts: Recruit, brief, calibrate, and review experts across coding, agentic/tool-use, and STEM/reasoning.
• Lab relationships: Be the main contact for lab partners via Slack and calls, with CEO support.
• Pilot delivery: Own pilots end to end—from scoping to delivery and QC.

Skills

Technical delivery

Quality assurance

Program management

AI/ML data

Lab benchmarking

Job description

Anyone AI Inc. is seeking a senior professional to own data initiatives and proposals for AI labs, from initial data proposals to pilot delivery.

You will shape frontier-grade sample packages across reasoning, coding, agents, and tools, collaborating with experts to ensure ground truth and enterprise-grade quality. This role sits at the operational center of the Human Data Division on a remote, international team.