Senior AI Evaluations Researcher (Remote)

Bazeta; United States; Remote; USD 140,000 - 230,000; Full time

Job summary

Figma is hiring a Senior Researcher, AI Evaluations to join AI Insights within Figma’s Research team. This senior IC role reports to the AI Insights lead and focuses on evaluating AI products, building robust rubrics, and advancing evaluation methods.

You will own evaluation research for priority AI workstreams, translate findings into product improvements, and collaborate with researchers and engineers to scale rigorous assessments. This role can be remote in the United States.

Qualifications

• 7+ years of experience in research, applied research, or related field and proven ability to lead evaluation projects.
• Experience evaluating AI products and translating findings into model/product improvements.
• Expertise in designing human evaluations, scoring rubrics, datasets and benchmarks.
• Strong qualitative and quantitative research skills and ability to interpret uncertainty.
• Excellent problem-solving and stakeholder management skills.

Responsibilities

• Own evaluation research for priority AI workstreams.
• Define quality criteria, design studies, analyze results and recommend actions.
• Build rubrics, datasets, benchmarks reflecting user needs and expert judgment.
• Collaborate with AI Research and Modeling Platform engineers to integrate methods.
• Explain quality, failure patterns, and uncertainty; guide model and product decisions.
• Validate automated graders against human ratings and identify bias or gaps.
• Share reusable methods and mentor peers.

Skills

AI evaluation

Research leadership

Rubrics design

Statistical analysis

Qualitative analysis

Cross-functional

Tools

Braintrust

LangSmith

DeepEval

Job description

Figma is hiring a Senior Researcher, AI Evaluations to join AI Insights within Figma’s Research team. This senior IC role reports to the AI Insights lead and focuses on evaluating AI products, building robust rubrics, and advancing evaluation methods.

You will own evaluation research for priority AI workstreams, translate findings into product improvements, and collaborate with researchers and engineers to scale rigorous assessments. This role can be remote in the United States.