Senior AI Benchmark Problem Designer (Contract)

SmartRecruiters, Inc.; Florida City (FL); Vor Ort; USD 90.000 - 130.000; Vollzeit

Zusammenfassung

SmartRecruiters, Inc. seeks a seasoned technical expert to design and present hard problems for AI benchmarking.

You will craft tasks in a Linux terminal drawn from your domain, ensuring they resist current frontier models when tested by multiple AI systems. Ideal candidates hold a Masters or higher, 10+ years of experience in a technical field, at least one publication, and demonstrated coding, systems, and security expertise.

Qualifikationen

• Masters degree or higher required.
• 10+ years of professional experience in a technical domain.
• At least one publication (academic or professional).
• Strong coding, systems, and security capabilities.

Aufgaben

• Design hard problems from your field to benchmark AI models.
• Create tasks in a Linux terminal that challenge current frontier systems.
• Contribute to a 7-week contract engagement and support onboarding.

Kenntnisse

Coding

Systems

Security

Publications

Ausbildung

Masters degree or higher

Jobbeschreibung

SmartRecruiters, Inc. seeks a seasoned technical expert to design and present hard problems for AI benchmarking.

You will craft tasks in a Linux terminal drawn from your domain, ensuring they resist current frontier models when tested by multiple AI systems. Ideal candidates hold a Masters or higher, 10+ years of experience in a technical field, at least one publication, and demonstrated coding, systems, and security expertise.