Psychometrician / Student Assessment Development Specialist

Team Carney, Inc.; Quantico (VA); On-site; USD 120,000 - 180,000; Full time

Job summary

Team Carney, Inc. seeks a Psychometrician / Student Assessment Development Specialist at Quantico, VA, in a 100% on-site, SCIF environment. You will lead analyses, build and validate exams, and ensure test integrity while supporting executive decision making.

Requirements include a Master’s in Psychology with a psychometrics specialization, 3+ years in assessment development, and an active TS/SCI clearance. Excel mastery and strong reporting skills are essential for success.

Qualifications

• Master’s degree in Psychology with a designated specialization as required.
• Minimum three years developing student assessment instruments or conduct training needs analysis.
• Active TS/SCI clearance at proposal and award time.
• Strong written communication to distill empirical findings into executive reports.

Responsibilities

• Lead training needs assessments, test construction, validation, and empirical measurement.
• Develop statistically sound assessment instruments and oversee exam integrity in secure environments.
• Perform test item analyses and trend analyses to validate student achievement.
• Draft executive-level metrics and summaries for governance reports.
• Advise leadership on testing policy, remediation pathways, and security considerations.
• Ensure testing architectures meet COE accreditation criteria and defense policies.

Skills

Excel proficiency

Written communication

Executive reporting

TS/SCI clearance

Education

Master’s degree in Psychology with I/O/Organizational/Personality/Quantitative specialization or educational measurement/psychometrics

Tools

Microsoft Excel

Job description

Position Title: Psychometrician / Student Assessment Developer
Location: Quantico, VA (Russell Knox Building)
Work Modality: 100% On-Site (SCIF Environment)
Security Clearance: Active Top Secret / Sensitive Compartmented Information (TS/SCI)

About Team Carney

Carney specializes in empirical learning validation, human capital analytics, and instructional system rigor. We ensure defense education initiatives deliver measurable competency outcomes and institutional accreditation excellence across all operational domains.

Position Overview

Carney is seeking a highly analytical Psychometrician / Student Assessment Development Specialist to lead training needs assessments, test construction, validation, and empirical measurement across JCITA’s training enterprise at Quantico, VA. The Psychometrician develops statistically sound assessment instruments, oversees exam integrity within secure facilities, and conducts comprehensive test item and trend analyses to validate student achievement and brief executive stakeholders.

Essential Duties & Responsibilities

• Design, build, and validate objective student assessment instruments—including criterion-referenced written exams, performance rubrics, and practical exercise evaluation scorecards.

• Conduct and participate in training needs analyses, practice analyses, and task analyses (CDRL A014) to define observable, measurable student performance requirements.

• Perform classical and modern test item analyses (item difficulty, discrimination indices, reliability coefficients) to optimize exam item banks and identify testing anomalies.

• Aggregate and analyze end-of-course (EOC) student evaluations and curriculum survey data; draft high-impact analytical summaries within two (2) days of survey receipt (CDRL A011).

• Author executive-level metric and evaluation briefings, including the Annual EOC Metrics Report (CDRL A013) and the Annual Board of Governors Report (CDRL A012).

• Advise JCITA leadership, academic deans, and course chairs on best practices in testing policy, remediation pathways, test security, and psychometric standards.

• Ensure testing architectures uphold strict Council on Occupational Education (COE) accreditation criteria and defense counterintelligence academic policies.

Required Minimum Qualifications (Hard Contractual Baselines)

• Security Clearance: Must hold an active, verified Top Secret / SCI (TS/SCI) clearance at the time of proposal and award.

• Education (Mandatory – No Degree Waiver): Master’s degree in Psychology with a designated specialization in:

  • Industrial/Organizational (I/O) Psychology,

  • Organizational Behavior,

  • Personality Research,

  • Quantitative Methods, or

  • An equivalent graduate degree in educational measurement/psychometrics.

• Experience: Minimum of three (3) years of dedicated experience developing student assessment instruments, constructing valid test rubrics, or conducting formal training needs analysis.

• Technical & Analytical Proficiency: Demonstrated hands-on proficiency using Microsoft Excel for complex statistical analyses, trend reporting, data structuring, and visualization.

• Communication Skills: Demonstrated excellent written communication skills with proven ability to distill complex empirical findings into clear executive reports.

Preferred Qualifications

• Prior experience conducting psychometric validation for federal law enforcement, military, or intelligence training programs.

• Working knowledge of specialized statistical analysis software (e.g., SPSS, R, Python) alongside advanced Excel modeling.

• Experience presenting empirical findings to senior military flag officers and Defense Senior Executive Service (SES) leaders.