Collaborative problem solving specialist

Eticas.AI; United States; Remote; USD 179,000 - 234,000; Full time

Job summary

Eticas.AI seeks an independent expert to define and score collaborative problem solving in middle-school group work. The role is remote, hourly-based with an initial defined scope.

You will work with transcripts or recordings, apply CPS rubrics, and help build standards and datasets. Compensation is $130–$170 per hour, invoiced monthly.

Qualifications

• Experience researching collaborative problem solving or collaborative learning assessment (e.g., PISA 2015 CPS, ATC21S).
• Ability to code or score student collaboration from transcripts or audio.
• Knowledge of NSF iSAT and similar corpora.

Responsibilities

• Define CPS construct and evidence model.
• Review the CPS rubric and update as needed.
• Design CPS rater training and support during scoring.
• Interpret CPS results for decision contexts.

Skills

CPS research

scoring from transcripts/audio

NSF iSAT familiarity

Job description

Collaborative problem solving specialist

Expert in defining what collaborative problem solving looks like in middle-school group work and how it can be scored from transcripts and recordings.

Individual

As Eticas expands its work on AI in Education in Europe and the US, we are looking to engage independent experts with different levels of expertise to make sure we have everyone at the table and different perspectives to assess our work. Engagements are remote, hourly-based and paid, with an initial defined scope.

Our work is focused on understanding how we can measure AI impacts on learning, and whether we have the tools to measure the right things and support the students who need it. We are also working to build standards so we have homogenized, comparable datasets to understand how learning is changing over time, what works and what doesn't, and for whom.

Working with schools, education authorities and edtech developers, we are testing AI scoring of complex student skills (written reasoning, collaborative problem solving, spoken reasoning) against trained teacher raters, and producing metrics and evidence that show when AI in learning can be trusted, and when it can't.

Our focus is on how AI performs on real student work, judged by real teachers, under real classroom conditions. We get as close as possible to the lived experience of learning and measure it, with the same discipline Eticas has applied for over a decade to AI in hiring, health and public services, among others.

This open call is part of our commitment to openness, inclusion and transparency, so that more voices can join this crucial work.

About the role

CPS construct definition and evidence model (by Nov 20);

Review of the CPS rubric (Dec 11);

Design of the CPS rater training (Jan 4 to 8) and support during scoring (Jan 11 to 15);

Interpretation of CPS results for D5 and D6.

Who we are looking for / competencies

Research record in collaborative problem solving or collaborative learning assessment (PISA 2015 CPS, ATC21S, learning analytics on group discourse, dialogue coding of student collaboration);

Has coded or scored student collaboration from transcripts or audio, not only designed tasks;

Knows the NSF iSAT and similar corpora.

Not a fit: general collaboration or teamwork researchers without student assessment work.

Dedication

6 days between Oct 26 and Jan 15, with 4 of them between Nov 9 and Dec 11. Remote.

Compensation

$130-170 per hour depending on seniority and fit, invoiced monthly against hours worked.