Remote AI Benchmarking Scientist — Complex Problems

Truelancer AI; United States; Remote; USD 110,000 - 165,000; Part time

Benefits offered by this job

Remote freelance project

Job summary

Truelancer AI is seeking domain experts, researchers, and PhDs to contribute to an advanced AI Benchmarking Project, designing and evaluating high-complexity scientific and technical problems that require hours to solve.

As a Science Benchmarking Expert, you will craft challenging problems, develop structured solution approaches, identify assumptions and edge cases, and help assess whether AI systems can solve them in remote, project-based freelance engagements.

Qualifications

• PhD preferred in a relevant scientific, technical, mathematical, or quantitative discipline.
• Master's degree holders with strong relevant expertise may also be considered.
• Equivalent indicators of deep domain expertise may be considered for exceptional candidates.

Responsibilities

• Design highly complex, challenging problem statements within your area of expertise.
• Create problems that require several hours or more for a qualified human expert to solve.
• Develop a structured and logically sound solution approach for each problem.
• Clearly identify assumptions, constraints, edge cases, and other details required for a correct solution.
• Explain why the problem is challenging or computationally/reasoning intensive.
• Estimate the approximate effort required for a qualified domain expert to solve the problem.
• Review problems for ambiguity, correctness, consistency, and uniqueness of the expected answer.
• Adapt problem statements based on project-specific benchmarking requirements.
• Evaluate problems using available AI tools/models and determine whether AI systems can solve them successfully.
• When an AI system fails, identify where and why the reasoning fails.
• Help distinguish between problems that are genuinely difficult and problems that are simply poorly defined.

Skills

Complex Thinking & Problem Design

Communication

Structured Problem Solving

Attention to Detail

Adaptability

AI Familiarity

Education

PhD preferred

Master's degree with strong expertise

Equivalent indicators of deep domain expertise

Job description

Truelancer AI is seeking domain experts, researchers, and PhDs to contribute to an advanced AI Benchmarking Project, designing and evaluating high-complexity scientific and technical problems that require hours to solve.

As a Science Benchmarking Expert, you will craft challenging problems, develop structured solution approaches, identify assumptions and edge cases, and help assess whether AI systems can solve them in remote, project-based freelance engagements.