Research Scientist II (LLM Evaluation Expert - Domain: Chemistry)

INTELLISWIFT INC; Seattle (WA); Remote; USD 50,000 - 70,000; Part time

Job summary

A leading company seeks an LLM Evaluation Expert specializing in Chemistry to assess and enhance AI language models' capabilities. This pivotal role requires advanced Chemistry knowledge, critical evaluation skills, and the ability to communicate complex concepts effectively. You'll influence the development of AI Chemistry assistants, impacting scientific computing and research.

Qualifications

• 5+ years in Chemistry research or applied Chemistry.
• Experience in evaluating Chemistry proofs and solutions.

Responsibilities

• Evaluate LLM-generated Chemistry solutions and provide feedback.
• Collaborate with AI research team for improvements in LLM.

Skills

Analytical Skills

Decision-Making

Communication

Education

Ph.D. in Chemistry

Job description

100% Remote
Only 20 hours per week, no wiggle room on this.

Must Have
Advanced degree (Ph.D. preferred) in Chemistry or a closely related field
Extensive experience (5+ years) in Chemistry research, problem-solving, or applied Chemistry across multiple subfields
Previous experience working with or evaluating AI systems, particularly in the context of mathematical problem-solving

Job Description:
As an LLM Evaluation Expert specializing in Chemistry, you will play a crucial role in assessing and improving our language models' Chemistry capabilities.
Your expertise will be instrumental in evaluating LLM-generated Chemistry solutions, making high-level judgments, and setting the standard for excellent AI-assisted Chemistry problem-solving.

Key Responsibilities:
• Critically analyze and evaluate Chemistry responses generated by our LLMs across various fields of Chemistry
• Exercise expert judgment to select the most appropriate and efficient Chemistry solutions from multiple LLM-generated options
• Make informed decisions on behalf of our customers, ensuring solutions meet rigorous Chemistry standards, are logically sound, and address specific research or application needs
• Develop and write Chemistry demonstrations to illustrate "what good looks like" in AI-generated solutions, setting benchmarks for accuracy, elegance, and insight
• Provide detailed feedback and explanations for your evaluations, helping to refine and improve the LLM's understanding and output of Chemistry concepts
• Collaborate with the AI research team to identify areas for improvement in the LLM's reasoning and problem-solving capabilities
• Stay updated with the latest developments in Chemistry and AI to ensure our evaluations remain cutting-edge
• Use your expertise to provide step-by-step solutions and explanations to complex problems in Chemistry, including inductive/deductive reasoning, experimental design, data interpretation, and systems-level thinking.

Required Qualifications:
• Advanced degree (Ph.D. preferred) in Chemistry or a closely related field
• Extensive experience (5+ years) in Chemistry research, problem-solving, or applied Chemistry across multiple subfields
• Demonstrated ability to critically evaluate Chemistry proofs, solutions, and reasoning for correctness, efficiency, and elegance
• Strong analytical and decision-making skills, with the ability to make complex judgments in abstract and theoretical contexts
• Excellent written and verbal communication skills, with the ability to explain complex Chemistry concepts clearly
• Experience in technical writing, particularly in creating mathematical proofs, explanations, or tutorials

Preferred Qualifications:
• Previous experience working with or evaluating AI systems, particularly in the context of mathematical problem-solving
• Familiarity with computer algebra systems, numerical computing environments, and mathematical software packages
• Understanding of machine learning concepts, especially as they apply to mathematical reasoning and problem-solving
• Experience in creating or contributing to Chemistry textbooks, research papers, or educational content.

This role requires a unique blend of Chemistry expertise, critical thinking, and communication skills. You will be the bridge between advanced AI technology and practical, real-world applications in Chemistry. Your work will directly influence the development of next-generation AI Chemistry assistants, potentially transforming fields such as scientific computing, data analysis, and Chemistry research.
If you're passionate about Chemistry, have a keen eye for elegant solutions, and are excited about the potential of AI in advancing the understanding of Biology, we encourage you to apply for this pivotal role at AGI Data Services.