Exercise and Training Evaluator

Applied Training Solutions; Saint Albans (ME); On-site; USD 60,000 - 90,000; Full time

Job summary

Applied Training Solutions is seeking an experienced Exercise and Training Evaluator for various locations in Virginia. This position entails assessing the effectiveness of training programs and operational exercises to support compliance and preparedness. The evaluator evaluates participant performance and gathers data for continuous improvement efforts.

Applicants must have experience in evaluating training programs, be familiar with HSEEP standards, and possess strong analytical skills. This position requires U.S. citizenship and may involve travel up to 100% while on assignment.

Qualifications

• Experience evaluating training programs, drills, or exercises.
• Knowledge of exercise design and evaluation methodologies.
• Ability to produce clear, concise, and actionable reports.

Responsibilities

• Observe and evaluate exercises including seminars and workshops.
• Assess participant performance against exercise objectives.
• Analyze findings to identify strengths and areas for improvement.

Skills

Evaluating training programs

Analytical skills

Documentation skills

Observation skills

Job description

Position: Exercise and Training Evaluator

Posted: 01/14/2026

Exercise and Training Evaluator

1099 - Consultant
Various locations within the Commonwealth of Virginia

Position Summary

Applied Training Solutions, LLC is seeking an experienced exercise and training evaluator. The Exercise and Training Evaluator is responsible for assessing the design, delivery, and effectiveness of training programs and operational exercises. This role evaluates participant performance, organizational readiness, and capability outcomes to support continuous improvement, compliance, and preparedness objectives. The Evaluator works closely with planners, instructors, and stakeholders to document strengths, identify gaps, and recommend corrective actions.

Responsibilities

• Observe and evaluate exercises including seminars, workshops, tabletop, functional, and full‑scale exercises in accordance with HSEEP doctrine
• Assess participant performance against exercise objectives, core capabilities, and critical tasks
• Evaluate participant actions, decision‑making, communications, and adherence to plans, procedures, and doctrine
• Use HSEEP‑compliant evaluation tools, including Evaluator Guides, data collection forms, and performance measures
• Apply established evaluation criteria, exercise objectives, and performance measures (e.g., capabilities, core competencies)
• Collect data through observation, evaluator worksheets, interviews, hot washes, and after‑action discussions
• Analyze findings to identify strengths, areas for improvement, and root causes
• Develop After‑Action Reports (AARs) and Improvement Plans (IPs) in accordance with applicable HSEEP standards
• Track corrective actions and support continuous improvement efforts
• Coordinate with exercise planners and training staff to ensure evaluation objectives align with exercise goals
• Maintain objectivity and confidentiality throughout the evaluation process
• Support accreditation, compliance, and readiness reporting requirements
• Maintain accurate logs and records for use in after‑action reporting and future planning

Basic Qualifications

• Experience evaluating training programs, drills, or exercises
• Knowledge of exercise design and evaluation methodologies
• Strong observation, analytical, and documentation skills
• Ability to produce clear, concise, and actionable reports
• Familiarity with Homeland Security Exercise and Evaluation Program (HSEEP)
• Must be a U.S. citizen

Preferred Qualifications

• 5+ years of experience in emergency management or planning roles
• EMA HSEEP training (e.g., IS‑120, IS‑130, IS‑139, or equivalent)
• Experience with core capabilities, THIRA/SPR, or capability‑based planning
• Experience evaluating multi‑agency, multi‑jurisdictional exercises
• Advanced IC S training (ICS‑300, 400, and E/L/G‑449 or equivalent)
• Knowledge of FEMA, EMAC, and mutual aid coordination processes
• MEPP qualified (Master Exercise Practitioner Program) or demonstrated equivalent experience supporting complex, multi‑agency HSEEP‑compliant exercises

Other Requirements

• U.S. Citizenship Required: Yes
• Performance Location: On‑site while on assignment (various locations within the Commonwealth of Virginia)
• Relocation Assistance: Not applicable
• Clearance Required: None
• Travel Required: Yes - up to 100% while on assignment

Working Environment

The work environment will include EOCs, field sites, or office locations depending on assignment. The position may require extended work hours beyond 12 hours per day, working under high operational tempo, and travel to locations throughout the Commonwealth of Virginia.

About Applied Training Solutions, LLC

Applied Training Solutions, LLC is a leading simulations company providing innovative systems, products, and solutions to government and commercial customers.

We are committed to hiring and retaining a diverse workforce. We are an Equal Opportunity Employer and make all employment decisions without regard to race, color, religion, sex, national origin, age, veteran status, disability, or any other protected class. U.S. citizenship is required for most positions.