Founding AI Learning & Evaluation Scientist

Studyfetch; Beverly Hills (CA); On-site; USD 150,000 - 210,000; Full time

Benefits offered by this job

Medical, Dental, Vision (100% employer

75% dependent coverage

401(k) with employer matching

Daily team dinner in-office

Mission-driven small team

Job summary

Studyfetch Beverly Hills, CA, is seeking an AI Research Scientist focused on learning and evaluation. You will build the evaluation layer under model training and learning science across Learn Engine and the Honen platform, driving metrics that matter for student outcomes.

You’ll own multi-turn tutoring benchmarks, evaluate models in production, and align research with product decisions in a founding-team setting.

Qualifications

• PhD in statistics, computer science, machine learning or quantitative field with 5+ years applying it to real products or research.
• Experience evaluating AI products in production and a strong causal reasoning mindset.
• Ability to design, run and defend experiments and benchmarks for AI models.
• Strong communication skills and clarity in writing and speaking.

Responsibilities

• Own the evaluation framework for the models we train and deployed.
• Design and run evals against candidate models, including safety and reliability checks.
• Build an internal benchmark for tutoring conversations and publish results when appropriate.
• Bridge product data and model training to drive measurable improvements.

Skills

Evaluation for AI products

Experimental design

Causal inference

Bayesian methods

LLM evaluation

Education

PhD in statistics, CS, ML or related field

Tools

MongoDB

PostgreSQL

Vector databases

GCP

Job description

Studyfetch Beverly Hills, CA, is seeking an AI Research Scientist focused on learning and evaluation. You will build the evaluation layer under model training and learning science across Learn Engine and the Honen platform, driving metrics that matter for student outcomes.

You’ll own multi-turn tutoring benchmarks, evaluate models in production, and align research with product decisions in a founding-team setting.