Economics AI Benchmarking Expert– Complex Problem Creation

Truelancer AI; United States; A distancia; USD 22.000 - 44.000; A tiempo parcial

Descripción de la vacante

Truelancer AI seeks Economics Benchmarking Expert to design challenging problems across micro, macro, econometrics, and game theory. You will craft multi-hour tasks, outline assumptions, and provide defensible evaluation methods for AI systems.

This remote freelance role demands rigorous analytical skills and the ability to assess AI performance on complex economics. Engagement is project-based with remote work from India, requiring CST/EST-friendly availability and strong research credentials,

Formación

• PhD in Economics or equivalent strong research background.
• Ability to design genuinely challenging economics problems.
• Experience with quantitative or mathematical economics is valuable.

Responsabilidades

• Design highly complex economics problem statements requiring advanced domain expertise.
• Create problems requiring hours or more to solve for economists or researchers.
• Develop structured, defensible solution approaches with clear assumptions and data needs.
• Incorporate economic models, theories, and quantitative methodologies into problem design.
• Explain why problems are challenging and reasoning-intensive.
• Estimate effort for solving problems and review for ambiguity and solvability.
• Adapt statements to project benchmarking needs and evaluate with AI tools.

Conocimientos

Advanced economics

Problem design

Complex analytical thinking

Structured problem solving

Attention to detail

Research & critical thinking

AI familiarity

Educación

PhD in Economics preferred

Master's in Economics (or quantitative field)

Descripción del empleo

Economics AI Benchmarking Expert

About the Project

Truelancer AI is looking for exceptional Economics domain experts, researchers, and PhDs to contribute to an advanced AI Benchmarking Project.

The project focuses on creating and evaluating highly complex economics problems designed to assess the reasoning, analytical, quantitative, and problem-solving capabilities of modern AI systems.

You will use your expertise in economics to design challenging problems that may require several hours or more for a qualified economist or researcher to solve. You will also develop structured solution approaches and evaluate whether current AI systems can successfully reason through these problems.

This is an opportunity to work at the intersection of advanced economics, complex problem solving, and Artificial Intelligence evaluation.

Engagement Details

• Engagement Type: Project-based / Freelance Contract

• Work Mode: Remote

• Location: India

• Preferred Time Zones: CST & EST availability preferred

• Domain: Economics

What You Will Do

As an Economics AI Benchmarking Expert, you will:

• Design highly complex and challenging economics problem statements requiring advanced domain expertise, quantitative analysis, and multi-step reasoning.

• Create problems that may require several hours or more for a qualified economist or researcher to solve.

• Develop structured, logically sound, and defensible solution approaches.

• Clearly define assumptions, constraints, variables, data requirements, and expected outcomes.

• Incorporate appropriate economic models, theories, frameworks, and quantitative methodologies into problem design.

• Explain why a problem is challenging, reasoning-intensive, computationally demanding, or difficult for current AI systems.

• Estimate the approximate effort required for a qualified economics expert to solve the problem.

• Review problems for ambiguity, correctness, consistency, solvability, and uniqueness of the expected answer.

• Adapt and refine problem statements based on project-specific AI benchmarking requirements.

• Evaluate problems using available AI tools and LLMs to determine whether AI systems can solve them successfully.

• Analyse incorrect or incomplete AI responses and identify where and why the reasoning fails.

• Distinguish between genuine reasoning challenges and problems that are simply ambiguous, poorly defined, or lacking sufficient information.

• Ensure that benchmark problems have a clearly defensible solution or evaluation methodology.

Key Skills Required

1. Advanced Economics & Problem Design

Strong ability to formulate sophisticated economics problems involving areas such as:

• Microeconomics

• Macroeconomics

• Econometrics

• Game Theory

• Development Economics

• International Economics

• Financial Economics

• Labour Economics

• Public Economics

• Industrial Organisation

• Behavioural Economics

• Environmental Economics

• Monetary Economics

• Economic Policy

• Applied Economics

Experience in quantitative or mathematical economics is highly valuable.

2. Complex Analytical Thinking

Ability to work through problems involving:

• Multi-step economic reasoning

• Quantitative and mathematical analysis

• Economic modelling

• Causal reasoning

• Data interpretation

• Statistical or econometric analysis

• Trade-offs and competing economic incentives

• Counterfactual analysis

• Policy impact assessment

3. Structured Problem Solving

Ability to break down complex economics problems into clearly defined steps and develop a rigorous solution methodology.

You should be comfortable identifying:

• Relevant economic theories and models

• Key assumptions

• Variables and parameters

• Constraints

• Appropriate analytical methods

• Expected outputs

• Alternative interpretations

4. Attention to Detail

Strong attention to detail, including the ability to:

• Identify hidden assumptions

• Define constraints explicitly

• Detect inconsistencies

• Validate calculations and economic reasoning

• Identify edge cases

• Check mathematical or statistical logic

• Ensure sufficient information is provided to solve the problem

• Ensure the expected outcome is well-defined and defensible

5. Research & Critical Thinking

Ability to evaluate complex economic scenarios, research relevant concepts, and determine whether a proposed problem genuinely tests advanced reasoning rather than simple knowledge recall.

6. AI Familiarity

Basic familiarity with modern AI tools and Large Language Models (LLMs).

You should be able to:

• Test complex economics problems using AI tools.

• Determine whether an AI system can correctly solve a problem.

• Identify incorrect, incomplete, or hallucinated AI responses.

• Analyse errors in economic reasoning, calculations, assumptions, or interpretation.

• Explain where an AI system's reasoning breaks down.

• Distinguish between an AI failure caused by lack of knowledge and one caused by reasoning or problem-solving limitations.

Eligibility

Education

• PhD in Economics preferred, particularly candidates with strong research or quantitative backgrounds.

• Master's degree in Economics or a closely related quantitative discipline with strong relevant expertise may also be considered.

• Candidates with equivalent evidence of advanced economics expertise may be considered based on their research, publications, professional experience, or demonstrated problem-solving ability.

Experience

No specific number of years of experience is required.

We are primarily interested in:

• Depth of economics expertise

• Analytical and quantitative ability

• Quality of reasoning

• Research experience

• Ability to design genuinely challenging economics problems

• Ability to develop rigorous and defensible solution methodologies

Candidates may demonstrate their expertise through academic research, publications, teaching, professional economics roles, consulting, econometric work, policy research, financial/economic analysis, or other relevant experience.

Who We Are Looking For

We are particularly interested in economists and researchers who enjoy working on difficult, open-ended, quantitative, and reasoning-intensive problems and can translate their domain expertise into rigorous AI evaluation benchmarks.

Guidelines

Truelancer AI verifies each project before posting.