IO Psych Testing Expert

NE Solutions; Hanover (MD); On-site; USD 90,000 - 135,000; Full time

Job summary

NE Solutions in Hanover, MD is seeking an experienced Instructional Testing Expert to support a federal customer. You will design and revise tests, collaborate with SMEs, and ensure alignment with KSAs and JQS.

You will conduct psychometric analyses, develop test blueprints, and prepare documentation and reports to meet contract requirements, ensuring rigorous validity and reliability across assessments.

Qualifications

• Experience designing, developing, and revising tests for technical evaluation programs.
• Familiarity with test design methodologies and item analysis to support evolving requirements.
• Proficient with Excel and SPSS; strong written and verbal communication skills.
• U.S. Citizenship is required.

Responsibilities

• Design, develop, and revise tests and assessments for highly technical programs.
• Collaborate with content developers and SMEs to design and develop assessments.
• Map KSAs/JQS to test questions and case studies through data gathering and analyses.
• Develop test blueprints and oversee knowledge tests and performance tasks.
• Prepare reports to satisfy contractual reporting requirements.
• Identify testing methods for learning solutions and develop testing strategies.
• Ensure tests are psychometrically sound through validity and reliability standards.
• Revise tests based on beta and pilot offerings and write contract documentation.

Skills

Test design

Item analysis

Psychometrics

MS Excel

SPSS Statistics

Technical testing

Education

PhD in Industrial/Organizational Psychology

PhD in Instructional Design and Human Performance Improvement

Tools

Excel

SPSS Statistics

Job description

Location: Hanover, Maryland 21076Employment Type: Full Time

NE Solutions is seeking an experienced Instructional Testing Expert to support our federal customer in Hanover, MD.

Responsibilities:

• Design, develop, and revise tests and/or assessments for highly technical evaluation programs
• Work closely with content developers and subject matter experts (SMEs) to design and develop formative and summative assessments
• Conduct data gathering and needs analyses to ensure learning objectives; Knowledge, Skills, and Abilities (KSA); and/or Job Qualification Standards (JQS) are mapped to test questions and case studies
• Develop test blueprints and oversee the creation of job-knowledge tests and performance-oriented assessments
• Develop reports to satisfy contractual reporting requirements
• Identify and develop the assessment and/or testing methods for learning solutions
• Develop the testing strategies for the program
• Apply validity and reliability standards to ensure tests are psychometrically sound
• Revise tests and/or assessments based on beta and pilot offerings of learning programs
• Write contract documentation to support all aspects of testing on the program
• Conduct research and provide recommendations on processes and procedures for test creation and administration
• Collaborate with subject matter experts and multi-disciplinary team members to develop measurable learning objectives and integrate tests into the course content of learning program
• Develop and utilize paper or electronic assessment instruments, such as multiple-choice selected responses, open ended, essay, case studies, performance-based tasks, role-play, pre-and post-tests, and simulations
• Conduct standard setting activities
• Apply psychometric formulas and theory to construct valid and reliable tests and measures of knowledge and/or performance-based assessments
• Conduct exam and item analysis
• Maintain detailed records of the exams for the program

Here’s what you’ll need:

• Experience designing, developing, and revising tests and/or assessments for highly technical evaluation programs
• Possess a broad range of experience related to test design and exam item analysis methodologies to effectively support customers with rapidly evolving requirements
• Familiarity with tools such as Excel, SPSS Statistics software, and applications used to deliver testing solutions
• Effective communication, writing, and requirements gatherings skills
• US Citizenship is required
• Time Management Skills — Managing one’s own time and the time of others. The ability to cooperate and collaborate with team members to adhere to project schedules and tight deadlines without sacrificing quality

Preferred:

• Academic/training industry experience
• Familiarity with DOD terminology
• Ph.D. in Industrial/Organizational Psychology or Instructional Design and Human Performance Improvement (or similar degree)