Research Scientist II

Aditi Consulting; Washington (District of Columbia); On-site; USD 150,000 - 200,000; Full time

Job summary

A leading company is seeking an LLM Evaluation Expert specializing in Physics to assess and enhance AI-generated Physics solutions. This role involves critical analysis, expert judgment, and collaboration with AI teams to ensure high standards in problem-solving. Ideal candidates will have a Ph.D. and extensive experience in Physics research.

Benefits

Medical Benefits

Dental Benefits

Vision Benefits

Paid Time Off

401(k)

Commuter Benefits

Insurance

Qualifications

• 5+ years of experience in Physics research or applied Physics.
• Ability to evaluate Physics proofs and solutions for correctness.

Responsibilities

• Analyze and evaluate Physics responses generated by LLMs.
• Provide detailed feedback to improve LLM's understanding of Physics concepts.

Skills

Analytical Skills

Decision-Making

Communication

Education

Ph.D. in Physics

Tools

Computer Algebra Systems

Mathematical Software

Job description

Get AI-powered advice on this job and more exclusive features.

This range is provided by Aditi Consulting. Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.

Base pay range

$48.00/hr - $53.00/hr

Payrate: 48.00 - $53.00/hr.

Summary:

As an LLM Evaluation Expert specializing in Physics, you will play a crucial role in assessing and improving our language models' Physics capabilities. Your expertise will be instrumental in evaluating LLM-generated Physics solutions, making high-level judgments, and setting the standard for what constitutes excellent AI-assisted Physics problem-solving.

Responsibilities:

• Critically analyze and evaluate Physics responses generated by our LLMs across various fields of Physics.
• Exercise expert judgment to select the most appropriate and efficient Physics solutions from multiple LLM-generated options.
• Make informed decisions on behalf of our customers, ensuring that selected solutions meet rigorous Physics standards, are logically sound, and address specific research or application needs.
• Develop and write Physics demonstrations to illustrate "what good looks like" in AI-generated solutions, setting benchmarks for accuracy, elegance, and insight.
• Provide detailed feedback and explanations for your evaluations, helping to refine and improve the LLM's understanding and output of Physics concepts.
• Collaborate with the AI research team to identify areas for improvement in the LLM's reasoning and problem-solving capabilities.
• Stay abreast with the latest developments in Physics and AI to ensure our evaluations remain cutting-edge.
• Using your expertise, provide step-by-step solutions and explanations to complex problems in Physics, including topics like projectile motion, electromagnetic fields, wave interference, energy conservation, and relativity.

Qualifications:

• Advanced degree (Ph.D. preferred) in Physics or a closely related field.
• Extensive experience (5+ years) in Physics research, problem-solving, or applied Physics across multiple subfields.
• Ability to critically evaluate Physics proofs, solutions, and reasoning for correctness, efficiency, and elegance.
• Strong analytical and decision-making skills, capable of complex judgments in abstract and theoretical contexts.
• Excellent written and verbal communication skills for explaining complex Physics concepts clearly.
• Experience in technical writing, including mathematical proofs, explanations, or tutorials.

Preferred Qualifications:

• Experience working with or evaluating AI systems, especially in mathematical problem-solving.
• Familiarity with computer algebra systems, numerical computing, and mathematical software.
• Understanding of machine learning concepts related to mathematical reasoning.
• Experience contributing to Physics textbooks, research papers, or educational content.

Pay Transparency:

The typical base pay across the U.S. is: $48.00 - $53.00/hr. Final offers depend on skills, education, experience, and benefits. Benefits may include medical, dental, vision, paid time off, 401(k), commuter benefits, and insurance.

For more info on data collection and privacy, see our Privacy Policy.

Aditi Consulting uses AI technology in the recruitment process, which gathers data but does not replace human decision-making. By applying, you agree to this use.

Seniority level

• Entry level

Employment type

• Contract

Job function

• Other

Industries

• Software Development

Referrals can increase your chances of interview by 2x.

Get notified about new Research Scientist jobs in Washington, DC.