Language Assessment Scientist for High-Impact Tests

Duolingo

Pittsburgh (Allegheny County)

On-site

USD 111,000 - 150,000

Full time

5 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Duolingo is seeking a language assessment expert to support test development and research for the Duolingo English Test. You will join our Assessment Research and Development team, collaborating across disciplines to design and evaluate innovative language assessments and ensure validity, reliability, and fairness.

You will work with measurement researchers, engineers, and designers to translate research findings into clear recommendations, publish findings, and contribute to digital assessment

Qualifications

  • PhD in language testing, applied linguistics, or related field.
  • Experience with high-stakes language assessments or similar research.
  • Expertise in language assessment, including validity, reliability, fairness, and measurement of language proficiency.

Responsibilities

  • Collaborate with measurement researchers, engineers, and designers to develop innovative, research-driven language assessments.
  • Design and evaluate assessment tasks, including new interactive item formats.
  • Conduct qualitative and quantitative studies examining validity, reliability, and fairness of assessment tasks and test scores.
  • Translate research findings into clear recommendations for technical and non-technical partners.
  • Share findings through reports, publications, blog posts, and presentations.

Skills

Project management
Organizational skills
Communication of research
Data-analysis proficiency

Education

PhD in language testing / applied linguistics / educational measurement

Tools

R
Python

Job description

Duolingo is seeking a language assessment expert to support test development and research for the Duolingo English Test. You will join our Assessment Research and Development team, collaborating across disciplines to design and evaluate innovative language assessments and ensure validity, reliability, and fairness.

You will work with measurement researchers, engineers, and designers to translate research findings into clear recommendations, publish findings, and contribute to digital assessment

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Language Assessment Scientist — Shape Global Tests
Language Assessment Scientist — Shape Global Tests

Life in Pittsburgh • Pittsburgh

On-site
USD 111,000 - 150,000
Language Measurement Scientist
Language Measurement Scientist

Duolingo • Pittsburgh

On-site
USD 111,000 - 150,000
Language Measurement Scientist
Language Measurement Scientist

Life in Pittsburgh • Pittsburgh

On-site
USD 111,000 - 150,000
Senior Product Manager — Scale a Global English Test
Senior Product Manager — Scale a Global English Test

Duolingo • Pennsylvania

On-site
USD 183,000 - 247,000
Senior Product Manager: English Test & Global Growth
Senior Product Manager: English Test & Global Growth

EngineersOfAI • New York (NY)

On-site
USD 150,000 - 190,000
Senior Product Manager, Global English Test
Senior Product Manager, Global English Test

EngineersOfAI • Pittsburgh

On-site
USD 120,000 - 150,000
Remote Assessment Design Lead – Language Proficiency & AI
Remote Assessment Design Lead – Language Proficiency & AI

Ladders • United States

Remote
USD 108,000 - 130,000
Remote work
Competitive compensation
Impactful language assessments
Research Assistant (Research)
Research Assistant (Research)

Duolingo • United States

Remote
USD 34,000 - 55,000
Assessment Design Lead
Assessment Design Lead

Ladders • United States

Remote
USD 108,000 - 130,000
Remote work
Competitive compensation
Impactful language assessments
Senior Engineering Manager, Product & Experiments
Senior Engineering Manager, Product & Experiments

Duolingo • Pennsylvania

On-site
USD 204,000 - 306,000