Navy Technical Assessment Architect

Valkyrie Enterprises, Inc.; Virginia Beach (VA); On-site; USD 75,000 - 110,000; Full time

Benefits offered by this job

Medical/Dental/Vision

401k with match

Education reimbursement

Paid holidays and PTO

Job summary

Valkyrie Enterprises, Inc. seeks a Test and Evaluation Specialist to support the Navy Afloat Maintenance Training Strategy (NAMTS).

The role focuses on developing and validating examinations and qualification tools to measure maintenance knowledge and hands-on proficiency in line with Navy standards. The successful candidate will work with Navy SMEs and instructional designers, translating maintenance tasks into observable criteria and ensuring assessment validity and reliability across

Qualifications

• Bachelor's degree or higher in a technical or instructional field with Navy training/assessment experience.
• Experience developing, reviewing, or validating Navy examinations and assessments.
• Knowledge of ISD, learning-objective development, criterion-referenced testing, and performance-based assessment methodologies.
• Ability to translate maintenance tasks into measurable assessment criteria and observable standards.
• Experience producing auditable assessment products traceable to references.

Responsibilities

• Analyze tasks, learning objectives, and requirements to identify assessment methods and criteria.
• Develop, review, and validate written exams, skills assessments, and evaluation checklists.
• Design criterion-referenced assessments and scoring rubrics.
• Create technical questions and scenario-based evaluations aligned with references.
• Establish performance indicators, safety requirements, and completion criteria for hands-on assessments.
• Evaluate items for technical accuracy and alignment with references.
• Ensure assessment validity, reliability, fairness, and consistent application.
• Maintain traceability between items, tasks, objectives, and references.
• Collaborate with Navy SMEs and instructional designers on assessment methods.
• Analyze examination results to identify knowledge or skill gaps and deficiencies.
• Conduct root-cause analyses and recommend corrective actions.
• Support JQR and examination reviews for alignment with Fleet requirements.
• Maintain documentation and configuration-controlled assessment products.

Skills

Test development

Performance assessment

ISD / ADDIE

Task analysis

Technical writing

SME collaboration

MS Office suite

Assessment instrumentation

Navy qualification standards

Education

Bachelor's degree in Instructional Design / related field

Associate's degree with Navy training experience

High school diploma with Navy training experience

Tools

Moodle

CeTARS

Navy LMS

Job description

Valkyrie Enterprises, Inc. seeks a Test and Evaluation Specialist to support the Navy Afloat Maintenance Training Strategy (NAMTS).

The role focuses on developing and validating examinations and qualification tools to measure maintenance knowledge and hands-on proficiency in line with Navy standards. The successful candidate will work with Navy SMEs and instructional designers, translating maintenance tasks into observable criteria and ensuring assessment validity and reliability across