AI Benchmarking: Physical Sciences Task Designer

Gramian Consulting Group; United States; Remote; USD 120,000 - 190,000; Full time

Job summary

Gramian Consultancy is seeking a Physical Sciences expert to craft realistic, terminal-based AI benchmarking tasks spanning physics, chemistry, materials science, and related fields. You will translate authentic workflows into reproducible environments with pinned dependencies and scientific software, ensuring numerical accuracy and reproducibility.

The role involves designing multi-step problems, implementing reference solutions across Python, C/C++, Julia, and Bash, and creating comprehensive

Qualifications

• Ph.D., postdoctoral experience or equivalent advanced technical experience in physics, chemistry, materials science, astronomy, computational science, or a related field.
• Strong programming skills in Python, C/C++, Julia, Bash, or another scientific programming language.
• Experience working in Linux or terminal-based environments.
• Hands-on experience with numerical methods, scientific modeling, simulations, or quantitative data analysis.

Responsibilities

• Design multi-step terminal-based tasks based on realistic physical-science workflows.
• Develop self-contained computational environments with pinned dependencies and scientific software.
• Create input datasets, molecular structures, simulation parameters, experimental data, and model configurations.
• Implement expert reference solutions using Python, Bash, C/C++, Julia, or domain-specific tools.
• Develop automated tests for numerical accuracy, physical consistency, convergence, and output structure.
• Create tasks involving simulations, numerical modeling, data fitting, optimization, spectroscopy, molecular analysis, and scientific visualization.
• Define appropriate numerical tolerances, units, boundary conditions, and expected scientific behavior.
• Validate that tasks are reproducible and execute successfully without runtime downloads.
• Debug issues involving dependencies, numerical precision, solver stability, performance, and file formats.
• Document scientific assumptions, expected behavior, and computational limitations for reviewers.

Skills

Python

C/C++

Julia

Bash

Linux

Numerical methods

Scientific modeling

Data analysis

Education

Ph.D., postdoctoral experience or equivalent

Job description

Gramian Consultancy is seeking a Physical Sciences expert to craft realistic, terminal-based AI benchmarking tasks spanning physics, chemistry, materials science, and related fields. You will translate authentic workflows into reproducible environments with pinned dependencies and scientific software, ensuring numerical accuracy and reproducibility.

The role involves designing multi-step problems, implementing reference solutions across Python, C/C++, Julia, and Bash, and creating comprehensive