Research Analyst, Education Measurement

Eticas.AI; United States; Remote; USD 55,000 - 110,000; Part time

Job summary

Eticas.AI is seeking an independent contractor to contribute to AI in Education research. The role involves drafting construct definitions for reasoning, collecting prior measurement work, and assembling student work samples under supervision.

This remote, hourly engagement targets mornings in US Eastern Time and welcomes global applicants. Responsibilities include coding failure modes as testing begins, maintaining a versioned constructs library, and coordinating with our research lead and

Qualifications

• Graduate training in education, educational measurement, learning sciences, psychology or related field.
• Reads assessment and learning-sciences literature fluently and writes clear, precise academic prose.
• Familiarity with rubrics, constructed-response scoring or evidence-centered design is a strong plus.
• Careful with data and tracking; R or Python is a plus.

Responsibilities

• Draft construct definitions for written reasoning, collaborative problem solving and spoken reasoning from research literature and frameworks.
• Search and extract prior measurement work and build a gap register.
• Assemble and track sets of student work samples with de-identification checks.
• Code and tabulate AI failure modes once model testing starts.
• Build and maintain a versioned constructs library with crosswalks between frameworks.

Skills

Written reasoning

Educational measurement

Rubrics familiarity

Data handling

Python

R

Education

Master's or PhD in education or related field

Tools

Python

R

Job description

The person who does the reading, drafting and coding behind our core research outputs.

US Eastern Time mornings - Remote, Open globally

Individual

As Eticas expands its work on AI in Education in Europe and the US, we are looking to engage independent experts with different levels of expertise to make sure we have everyone at the table and different perspectives to assess our work. Engagements are remote, hourly-based and paid, with an initial defined scope.

Our work is focused on understanding how we can measure AI impacts on learning, and whether we have the tools to measure the right things and support the students who need it. We are also working to build standards so we have homogenized, comparable datasets to understand how learning is changing over time, what works and what doesn't, and for whom.

Working with schools, education authorities and edtech developers, we are testing AI scoring of complex student skills (written reasoning, collaborative problem solving, spoken reasoning) against trained teacher raters, and producing metrics and evidence that show when AI in learning can be trusted, and when it can't.

Our focus is on how AI performs on real student work, judged by real teachers, under real classroom conditions. We get as close as possible to the lived experience of learning and measure it, with the same discipline Eticas has applied for over a decade to AI in hiring, health and public services, among others.

This open call is part of our commitment to openness, inclusion and transparency, so that more voices can join this crucial work.

About the role

Draft construct definitions for written reasoning, collaborative problem solving and spoken reasoning from the research literature and existing frameworks.

Search and extract prior measurement work (assessments, rubrics, benchmarks, including postsecondary and workforce frameworks) and build a gap register.

Assemble and track sets of student work samples, including de-identification checks.

Code and tabulate AI failure modes once model testing starts.

Build and maintain a versioned constructs library with crosswalks between frameworks.

Works with our research lead and senior experts.

Who we are looking for / Competencies

Graduate training (Master's or PhD, in progress or completed) in education, educational measurement, learning sciences, psychology or a related field.

Reads assessment and learning-sciences literature fluently and writes clear, precise academic prose.

Familiarity with rubrics, constructed-response scoring or evidence-centered design is a strong plus.

Careful with data and tracking; R or Python is a plus.

Not a fit: literature reviews only in AI policy, ethics or law, without education or measurement content.

Dedication

About 175 hours between late October 2026 and March 2027, heaviest from November to mid-December.

Compensation

Hourly, paid monthly as an independent contractor. Please state your expected hourly rate in your note.