AI Benchmark Engineer – 3D CAD & Spatial Evaluations

gNucleus AI; Sunnyvale (CA); On-site; USD 140,000 - 190,000; Full time

Job summary

gNucleus AI is seeking an AI Engineer to own our bench project and lead domain-specific AI evaluation harnesses for physical/spatial AI and 3D parametric CAD models and agents. You will create domain-specific evaluation tasks and benchmark datasets to build our comprehensive evaluation suite.

You will be the primary owner for our evaluation benchmarks, collaborating with Product, Research, and Safety teams to translate vague capability goals into automated benchmark pipelines and releases.

Qualifications

• PhD or Master’s in CS/ML or related field.
• 1–3 years hands-on with RLHF, preference modeling, or instruction tuning.
• Experience with LLM evaluation or benchmark development.
• Ability to create quantitative evaluation rubrics and reports.
• Strong communication and cross-functional collaboration.

Responsibilities

• Design domain-specific AI evaluation tasks and datasets.
• Build reproducible benchmark pipelines and releases.
• Develop robust evaluation harnesses and automated grading suites.
• Analyze model failure modes and translate insights into data requirements.
• Communicate results via benchmark reports and papers.

Skills

Deep learning

Reinforcement learning

LLM evaluation

Benchmark development

Data analysis

Education

PhD or Master’s in CS/ML

Tools

PyTorch

TensorFlow

Python

Job description

gNucleus AI is seeking an AI Engineer to own our bench project and lead domain-specific AI evaluation harnesses for physical/spatial AI and 3D parametric CAD models and agents. You will create domain-specific evaluation tasks and benchmark datasets to build our comprehensive evaluation suite.

You will be the primary owner for our evaluation benchmarks, collaborating with Product, Research, and Safety teams to translate vague capability goals into automated benchmark pipelines and releases.