Psychometrician / Student Assessment Development Specialist

Team Carney, Inc.; Virginia; On-site; USD 110,000 - 150,000; Full time

Job summary

Team Carney, Inc. is seeking a Psychometrician / Student Assessment Development Specialist to lead testing projects at Quantico, VA. The role involves building and validating assessments, performing analyses, and producing executive briefs to inform defense education initiatives.

The position requires a Master’s in Psychology with relevant specialization, 3+ years of experience in student assessment development, and an active TS/SCI clearance. On-site work in a secure facility is essential.

Qualifications

• Master’s degree in Psychology with a designated specialization as listed.
• Active TS/SCI clearance at time of proposal and award.
• 3+ years of experience developing student assessment instruments or training needs analysis.
• Proficiency in Excel for complex statistical analyses, trend reporting, and visualization.

Responsibilities

• Design, build, and validate objective student assessment instruments (exams, rubrics, performance scorecards).
• Conduct training needs analyses and task analyses to define measurable requirements.
• Perform item analyses to optimize exam item banks and identify anomalies.
• Aggregate and analyze end-of-course evaluations and survey data; draft executive summaries.
• Author executive-level metrics and evaluation briefings and annual reports.
• Advise leadership on testing policy, remediation, security, and psychometric standards.
• Ensure testing architectures meet COE accreditation criteria and defense policies.

Skills

Microsoft Excel

Statistical analysis

Data visualization

Written communication

Education

Master’s in Psychology (I/O/Organizational/Personality) or psychometrics

Tools

SPSS

R

Python

Job description

Position Title: Psychometrician / Student Assessment Developer
Location: Quantico, VA (Russell Knox Building)
Work Modality: 100% On-Site (SCIF Environment)
Security Clearance: Active Top Secret / Sensitive Compartmented Information (TS/SCI)

About Team Carney

Carney specializes in empirical learning validation, human capital analytics, and instructional system rigor. We ensure defense education initiatives deliver measurable competency outcomes and institutional accreditation excellence across all operational domains.

Position Overview

Carney is seeking a highly analytical Psychometrician / Student Assessment Development Specialist to lead training needs assessments, test construction, validation, and empirical measurement across JCITA’s training enterprise at Quantico, VA. The Psychometrician develops statistically sound assessment instruments, oversees exam integrity within secure facilities, and conducts comprehensive test item and trend analyses to validate student achievement and brief executive stakeholders.

Essential Duties & Responsibilities

• Design, build, and validate objective student assessment instruments—including criterion-referenced written exams, performance rubrics, and practical exercise evaluation scorecards.

• Conduct and participate in training needs analyses, practice analyses, and task analyses (CDRL A014) to define observable, measurable student performance requirements.

• Perform classical and modern test item analyses (item difficulty, discrimination indices, reliability coefficients) to optimize exam item banks and identify testing anomalies.

• Aggregate and analyze end-of-course (EOC) student evaluations and curriculum survey data; draft high-impact analytical summaries within two (2) days of survey receipt (CDRL A011).

• Author executive-level metric and evaluation briefings, including the Annual EOC Metrics Report (CDRL A013) and the Annual Board of Governors Report (CDRL A012).

• Advise JCITA leadership, academic deans, and course chairs on best practices in testing policy, remediation pathways, test security, and psychometric standards.

• Ensure testing architectures uphold strict Council on Occupational Education (COE) accreditation criteria and defense counterintelligence academic policies.

Required Minimum Qualifications (Hard Contractual Baselines)

• Security Clearance: Must hold an active, verified Top Secret / SCI (TS/SCI) clearance at the time of proposal and award.

• Education (Mandatory – No Degree Waiver): Master’s degree in Psychology with a designated specialization in:

  • Industrial/Organizational (I/O) Psychology,

  • Organizational Behavior,

  • Personality Research,

  • Quantitative Methods, or

  • An equivalent graduate degree in educational measurement/psychometrics.

• Experience: Minimum of three (3) years of dedicated experience developing student assessment instruments, constructing valid test rubrics, or conducting formal training needs analysis.

• Technical & Analytical Proficiency: Demonstrated hands-on proficiency using Microsoft Excel for complex statistical analyses, trend reporting, data structuring, and visualization.

• Communication Skills: Demonstrated excellent written communication skills with proven ability to distill complex empirical findings into clear executive reports.

Preferred Qualifications

• Prior experience conducting psychometric validation for federal law enforcement, military, or intelligence training programs.

• Working knowledge of specialized statistical analysis software (e.g., SPSS, R, Python) alongside advanced Excel modeling.

• Experience presenting empirical findings to senior military flag officers and Defense Senior Executive Service (SES) leaders.