Scientific Chemistry (Python, AI Evaluation)

Gramian Consulting; Brasil; Remote; BRL 180,000 - 270,000; Full time

Job summary

Gramian Consulting in Brazil seeks experts with a PhD in Chemistry and strong Python for scientific computing to design and verify complex chemistry problems with unit-tested Python solutions.

You will craft discriminative test cases, validate outputs, and iterate on tasks based on QC feedback, ensuring deterministic results and rigorous quality across AI evaluators.

Qualifications

• Master's degree or PhD in Chemistry.
• Strong Python programming skills with experience in scientific computing.
• Experience using NumPy, SciPy, SymPy or relevant tools.
• Ability to formulate rigorous scientific problems with clear constraints and outputs.
• Experience writing or implementing scientific solutions with unit tests and deterministic outputs.
• Prior experience in AI data annotation, scientific research, or scientific writing.
• Familiarity with LLM evaluation frameworks, coding benchmarks, or AI-generated code assessment.
• Published research or academic project involving chemistry or STEM.

Responsibilities

• Design scientific coding tasks consisting of one main chemistry problem and at least 3 progressively structured sub-problems.
• Develop verified golden solutions in Python with complete unit test coverage.
• Create discriminative test cases that distinguish correct from incorrect AI-generated outputs.
• Execute quality control validation through the Central Task Platform (CTP) including Tier 1 structural checks and Tier 2 rubrics.
• Iterate on task specifications, implementations, and test cases based on QC feedback.
• Optimize tasks to meet Pass@K evaluation criteria across multiple LLM judges.
• Ensure scientific correctness, determinism, and adherence to project quality standards.
• Maintain high first-submission quality and minimize rework.

Skills

Python programming

NumPy

SciPy

SymPy

Deterministic outputs

AI data annotation experience

Education

Master's or PhD in Chemistry

Tools

Unit testing frameworks

Job description

Responsibilities

• Design scientific coding tasks consisting of one main chemistry problem and at least 3 logically connected, progressively structured sub-problems
• Develop verified golden solutions in Python with complete unit test coverage
• Create discriminative test cases that distinguish correct from incorrect AI-generated outputs
• Execute quality control validation through the Central Task Platform (CTP), including Tier 1 structural checks and Tier 2 quality rubrics
• Iterate on task specifications, implementations, and test cases based on QC feedback
• Optimize tasks to meet Pass@K evaluation criteria across multiple LLM judges, including GPT, Gemini, and Nemotron
• Ensure scientific correctness, determinism, well-posedness, and adherence to project quality standards
• Maintain high first-submission quality and minimize rework, targeting consistent L1 approval
• Participate in review meetings, feedback sessions, and project standups during required overlap hours

Requirements

• Master's degree or PhD in Chemistry
• Strong Python programming skills with experience in scientific computing
• Experience using scientific Python libraries such as NumPy, SciPy, SymPy, or relevant domain-specific tools
• Ability to formulate rigorous scientific problems with clear constraints and expected outputs
• Experience writing or implementing scientific solutions with unit tests and deterministic outputs
• Prior experience in AI data annotation, scientific research, or scientific writing
• Familiarity with LLM evaluation frameworks, coding benchmarks, or AI-generated code assessment
• Published research or academic project experience involving chemistry or another STEM discipline