Conceptual Reasoning Researcher

Trajectory Labs, PBC

United States

Remote

USD 70,000 - 110,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Effectief Altruisme, a US-based organization focused on AI safety, governance, and alignment, is seeking a designer to craft evaluation tasks that test conceptual reasoning in governance, macrostrategy, and economics. The role centers on building rigorous rubrics and challenging prompts to assess model understanding.

You will develop rubrics, pinpoint hard questions where frontier models struggle, and iterate until tasks clearly distinguish strong reasoning from superficially plausible answers.

Responsibilities

  • Design AI safety evaluation tasks with rubrics that measure conceptual reasoning in governance, alignment, macrostrategy, or economics.
  • Identify hard conceptual questions where frontier models reason poorly; create well-posed problems paired with opinionated rubrics.

Job description

Design AI safety evaluation tasks with rubrics that measure conceptual reasoning in governance, alignment, macrostrategy, or economics. - Identify hard conceptual questions where frontier models reason poorly; create well-posed problems paired with opinionated rubrics. - Run tasks against frontier models, iterate until scores separate strong reasoning from plausible-sounding weak answers. - Requires original analysis in AI risk, alignment, macrostrategy, economics, or governance with articula…

Wie AI-modellen laat meedenken over moeilijke vragen, zoals hoe je krachtige AI veilig en bestuurbaar houdt, moet weten waar die modellen overtuigend klinken maar slecht redeneren. Jij bouwt de toetsen die dat zichtbaar maken: één goede toets meet elk volgend model opnieuw, al bepalen veiligheidsteams en beleidsmakers zelf wat ze met de uitkomsten doen.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Conceptual Reasoning & AI Safety Researcher
Conceptual Reasoning & AI Safety Researcher

Effectief Altruisme • United States

Remote
USD 70,000 - 110,000
Conceptual Reasoning Researcher: AI Risk & Theory
Conceptual Reasoning Researcher: AI Risk & Theory

Aisafety • Berkeley (CA)

On-site
USD 90,000 - 150,000
Conceptual Reasoning Researcher for AI Safety & Theory
Conceptual Reasoning Researcher for AI Safety & Theory

Redwood Research • Berkeley (CA)

On-site
USD 90,000 - 150,000
AI Researcher, AI Safety & Security
AI Researcher, AI Safety & Security

Tinycode • United States

Remote
USD 120,000 - 180,000
Research Contractor
Research Contractor

FutureSearch • United States

Remote
USD 55,000 - 110,000
Research Scientist, Manipulation Evals
Research Scientist, Manipulation Evals

Effectief Altruisme • United States

Remote
USD 110,000 - 160,000
Remote AI Safety Conceptual Reasoning Researcher
Remote AI Safety Conceptual Reasoning Researcher

Trajectory Labs, PBC • United States

Hybrid
USD 138,000 - 207,000
Research Scientist
Research Scientist

Effectief Altruisme • United States

Remote
USD 120,000 - 160,000
AI Evaluation & Agent Systems Engineer
AI Evaluation & Agent Systems Engineer

Syntony • United States

Remote
USD 120,000 - 190,000
Researcher, Conceptual Reasoning Capabilities
Researcher, Conceptual Reasoning Capabilities

Aisafety • Berkeley (CA)

On-site
USD 90,000 - 150,000