Research Scientist II

INTELLISWIFT INC; Seattle (WA); Remote; Part time

Job summary

A leading company is seeking an LLM Evaluation Expert specializing in Biology. This remote role requires an advanced degree and extensive experience in Biology research. You will assess AI-generated Biology solutions, ensuring they meet high standards. Your expertise will guide improvements in AI's problem-solving capabilities, making a significant impact in the field.

Qualifications

• 5+ years experience in Biology research or applied Biology.
• Ability to evaluate Biology proofs and solutions.

Responsibilities

• Analyze and evaluate Biology responses generated by LLMs.
• Provide feedback to improve LLM's understanding of Biology concepts.
• Collaborate with AI research team for improvements.

Skills

Problem-Solving

Analytical Skills

Communication

Education

Ph.D. in Biology

Job description

Pay rate range - $55/hr. to $54/hr. on W2
100% Remote
Schedule - Only 20 hours per week, no wiggle room on this.

Must Have
Advanced degree (Ph.D. preferred) in Biology or a closely related field
Extensive experience (5+ years) in Biology research, problem-solving, or applied Biology across multiple subfields
Previous experience working with or evaluating AI systems, particularly in the context of mathematical problem-solving

Job Description:
As an LLM Evaluation Expert specializing in Biology, you will play a crucial role in assessing and improving our language models' Biology capabilities.
Your expertise will be instrumental in evaluating LLM-generated Biology solutions, making high-level judgments, and setting the standard for what constitutes excellent AI-assisted Biology problem-solving.

Key Responsibilities:
• Critically analyze and evaluate Biology responses generated by our LLMs across various fields of Biology
• Exercise expert judgment to select the most appropriate and efficient Biology solutions from multiple LLM-generated options
• Make informed decisions on behalf of our customers, ensuring that selected solutions meet rigorous Biology standards, are logically sound, and address specific research or application needs
• Develop and write Biology demonstrations to illustrate "what good looks like" in AI-generated solutions, setting benchmarks for accuracy, elegance, and insight
• Provide detailed feedback and explanations for your evaluations, helping to refine and improve the LLM's understanding and output of Biology concepts
• Collaborate with the AI research team to identify areas for improvement in the LLM's reasoning and problem-solving capabilities
• Stay abreast with the latest developments in Biology and AI to ensure our evaluations remain cutting-edge
• Use your expertise to provide step-by-step solutions and explanations to complex problems in Biology, including inductive/deductive reasoning, experimental design, data interpretation, and systems-level thinking.

Required Qualifications:
• Advanced degree (Ph.D. preferred) in Biology or a closely related field
• Extensive experience (5+ years) in Biology research, problem-solving, or applied Biology across multiple subfields
• Demonstrated ability to critically evaluate Biology proofs, solutions, and reasoning for correctness, efficiency, and elegance
• Strong analytical and decision-making skills, with the ability to make complex judgments in abstract and theoretical contexts
• Excellent written and verbal communication skills, with the ability to explain complex Biology concepts clearly
• Experience in technical writing, particularly in creating mathematical proofs, explanations, or tutorials

Preferred Qualifications:
• Previous experience working with or evaluating AI systems, particularly in the context of mathematical problem-solving
• Familiarity with computer algebra systems, numerical computing environments, and mathematical software packages
• Understanding of machine learning concepts, particularly as they apply to mathematical reasoning and problem-solving
• Experience in creating or contributing to Biology textbooks, research papers, or educational content.