Research Scientist II

Aditi Consulting; Washington (District of Columbia); On-site; USD 150,000 - 200,000; Full time

Job summary

A leading company is seeking an LLM Evaluation Expert specializing in Biology. This role involves assessing AI-generated Biology solutions, providing expert feedback, and collaborating with research teams to enhance AI capabilities in Biology. Ideal candidates will have a Ph.D. and extensive experience in Biology research.

Benefits

Medical Insurance

Dental Insurance

Vision Insurance

Paid Time Off

401(k)

Qualifications

• 5+ years of experience in Biology research or applied Biology.
• Ability to evaluate Biology proofs and solutions.

Responsibilities

• Analyze and evaluate Biology responses generated by LLMs.
• Provide detailed feedback to improve LLM's understanding of Biology.

Skills

Analytical Skills

Communication Skills

Technical Writing

Education

Ph.D. in Biology

Tools

Computer Algebra Systems

Numerical Computing Environments

Job description

Base pay range

$48.00/hr - $53.00/hr

Payrate: $48.00 - $53.00/hr

Job Description

As an LLM Evaluation Expert specializing in Biology, you will play a crucial role in assessing and improving our language models' Biology capabilities. Your expertise will be instrumental in evaluating LLM-generated Biology solutions, making high-level judgments, and setting the standard for excellent AI-assisted Biology problem-solving.

Key Responsibilities:

• Critically analyze and evaluate Biology responses generated by our LLMs across various fields of Biology.
• Exercise expert judgment to select the most appropriate and efficient Biology solutions from multiple LLM-generated options.
• Make informed decisions on behalf of our customers, ensuring solutions meet rigorous Biology standards, are logically sound, and address specific research or application needs.
• Develop and write Biology demonstrations to illustrate "what good looks like" in AI-generated solutions, setting benchmarks for accuracy, elegance, and insight.
• Provide detailed feedback and explanations for your evaluations, helping to refine and improve the LLM's understanding and output of Biology concepts.
• Collaborate with the AI research team to identify areas for improvement in the LLM's reasoning and problem-solving capabilities.
• Stay updated on the latest developments in Biology and AI to ensure our evaluations remain cutting-edge.
• Use your expertise to provide step-by-step solutions and explanations to complex Biology problems, including inductive/deductive reasoning, experimental design, data interpretation, and systems-level thinking.

Required Qualifications:

• Advanced degree (Ph.D. preferred) in Biology or a closely related field.
• Extensive experience (5+ years) in Biology research, problem-solving, or applied Biology across multiple subfields.
• Ability to critically evaluate Biology proofs, solutions, and reasoning for correctness, efficiency, and elegance.
• Strong analytical and decision-making skills for complex judgments.
• Excellent communication skills to explain complex Biology concepts clearly.
• Experience in technical writing, including mathematical proofs, explanations, or tutorials.

Preferred Qualifications:

• Experience working with or evaluating AI systems in mathematical problem-solving.
• Familiarity with computer algebra systems, numerical computing environments, and mathematical software.
• Understanding of machine learning concepts related to mathematical reasoning.
• Experience contributing to Biology textbooks, research papers, or educational content.

Skills:

• Advanced degree (Ph.D. preferred) in Biology or a related field.
• 5+ years of experience in Biology research or applied Biology.
• Experience with AI systems in mathematical problem-solving.

Pay Transparency

The typical base pay across the U.S. is $48.00 - $53.00/hr. Final offers depend on skills, education, experience, and benefits. Full-time employees may choose from benefits like medical, dental, vision, paid time off, 401(k), and more.

Additional Information

For details on data collection, privacy, and AI technology use, see our Privacy Policy. By applying, you agree to AI technology use in our sourcing process.