Remote | Ph.D. / Postdoctoral / Master's Expert

24-Mag Llc; New York (NY); Remote; USD 80,000 - 150,000; Full time

Job summary

24-MAG LLC invites experts in advanced STEM fields to design and solve challenging problems for large language model evaluation. This remote, contractor-style engagement emphasizes rigorous reasoning, structured solutions, and detailed annotations, spanning physics, mathematics, biology, chemistry, and related disciplines.

Ideal candidates hold a Master’s, Ph.D., or postdoctoral position and demonstrate strong analytical and research capabilities, with clear English communication and the ability

Qualifications

• Must be pursuing or holding a Master’s, Ph.D., or postdoctoral position in a STEM field.
• Strong analytical and research capabilities with ability to solve complex quantitative and conceptual problems.
• Excellent written English communication and ability to explain technical concepts clearly.

Responsibilities

• Design challenging STEM problems across advanced domains for evaluation.
• Produce clear step-by-step solutions with explicit assumptions.
• Evaluate model responses and identify reasoning weaknesses.
• Contribute to evaluation design and benchmarking across disciplines.
• Collaborate remotely with AI researchers and provide constructive feedback.

Skills

Analytical thinking

Research skills

STEM reasoning

Explanations clarity

Problem solving

English communication

Remote collaboration

Self-motivation

Education

Master's/PhD/postdoc in STEM

Tools

Python

LaTeX

Job description

We are sharing a specialised opportunity for advanced STEM researchers and graduate-level experts to contribute to large language model evaluation and training through challenging scientific problem design, rigorous reasoning, and high-quality solution development.

Selected professionals will design and solve complex STEM problems, develop structured step-by-step explanations, identify areas where advanced AI systems struggle, and collaborate with research teams on evaluation strategies and benchmarks. The work is especially relevant to candidates with strong backgrounds in physics, mathematics, biology, chemistry, applied physics, or related disciplines.

Key Responsibilities

Advanced STEM Problem Development

• Design challenging problems across advanced STEM domains
• Create tasks that probe limitations in model reasoning
• Develop problems requiring abstraction and multi-step analysis
• Incorporate symbolic or quantitative reasoning where appropriate
• Maintain appropriate difficulty across undergraduate through doctoral-level topics

Problem Solving & Solution Development

• Solve complex STEM problems accurately and efficiently
• Produce clear step-by-step solutions
• Explain assumptions and intermediate reasoning explicitly
• Structure solutions for ease of evaluation and review
• Apply rigorous analytical methods throughout problem-solving workflows

Model Evaluation & Error Analysis

• Evaluate how large language models respond to advanced STEM tasks
• Identify recurring weaknesses in reasoning and problem decomposition
• Analyse errors involving abstraction, symbolic manipulation, or multi-step logic
• Distinguish conceptual mistakes from calculation or interpretation errors
• Provide structured observations to support model improvement

Benchmark & Evaluation Design

• Help define new STEM evaluation benchmarks
• Align problem design with specific research objectives
• Contribute tasks spanning different levels of technical difficulty
• Refine evaluation criteria based on observed model behaviour

Research Collaboration & Technical Communication

• Collaborate remotely with AI researchers and technical contributors
• Explain STEM concepts in clear and accessible language
• Provide constructive feedback and detailed annotations
• Communicate analytical findings in a structured format
• Work independently while maintaining reliable project delivery

Ideal Profile

• Currently pursuing or holding a Master's, Ph.D., or postdoctoral position in a STEM field
• Background in Physics, Applied Physics, Mathematics, Biology, Chemistry, or a related discipline
• Strong analytical and research capabilities
• Ability to solve complex quantitative and conceptual problems
• Strong foundation in advanced STEM reasoning
• Ability to break difficult concepts into clear explanations
• Comfortable with abstraction and multi-step reasoning
• Strong logical and structured problem-solving skills
• Ability to provide detailed annotations and constructive feedback
• Creative and lateral thinking abilities
• Excellent written English communication
• Strong remote collaboration skills
• Self-motivated and able to work independently
• Reliable desktop or laptop setup with a stable internet connection
• Ability to explain technical concepts using simple language, visuals, and scientific reasoning where appropriate

Engagement Details

• Contractor assignment / freelance engagement
• Fully remote
• Source materials describe the opportunity as full-time, while the formal engagement type is contractor/freelancer
• Work will involve advanced STEM problem design, solution development, model evaluation, and benchmark creation
• Projects may span physics, mathematics, biology, chemistry, and related scientific disciplines
• Physics-focused evaluation may include topics ranging from early undergraduate through Ph.D. level
• Collaboration will involve research teams working on advanced language-model evaluation
• Contract extension may be available depending on performance and project requirements
• No medical or paid-leave benefits are included under the stated contractor arrangement
• Work must be completed without using confidential, proprietary, unpublished research, restricted datasets, or otherwise protected information belonging to any employer, laboratory, university, research group, client, or other third party

About the Platform

This opportunity is available through 24-MAG LLC. We connect experienced professionals with remote consulting opportunities across technical, evaluation, and project-based workstreams.

By submitting this application, you acknowledge that your information may be processed by 24-MAG LLC for recruitment and opportunity matching in accordance with our Privacy Policy: https://www.24-mag.com/privacy-policy