Exercise and Training Evaluator

Applied Training Solutions; Washington (District of Columbia); On-site; USD 55,104 - 110,208; Part time

Job summary

Applied Training Solutions, LLC is seeking an experienced Exercise and Training Evaluator to assess the design, delivery, and effectiveness of training programs and exercises. The role focuses on evaluating participant performance, readiness, and capability outcomes to support improvement and compliance.

The Evaluator collaborates with planners, instructors, and stakeholders to document strengths and gaps, develop AARs and IPs, and track corrective actions on-site across Virginia assignments.

Qualifications

• Experience evaluating training programs, drills, or exercises.
• Knowledge of exercise design and evaluation methodologies.
• Strong observation, analytical, and documentation skills.
• Ability to produce clear, concise, and actionable reports.
• Familiarity with Homeland Security Exercise and Evaluation Program (HSEEP).
• Must be a U.S. citizen.

Responsibilities

• Observe and evaluate exercises including seminars, workshops, tabletop, functional, and full-scale exercises per HSEEP.
• Assess participant performance against objectives, core capabilities, and critical tasks.
• Evaluate participant actions, decision-making, communications, and adherence to plans.
• Use evaluation tools and performance measures; collect and analyze data.
• Develop After-Action Reports (AARs) and Improvement Plans (IPs).
• Track corrective actions and support continuous improvement.
• Coordinate with planners and staff to align evaluation objectives with goals.
• Maintain objectivity and confidentiality throughout the evaluation process.
• Support accreditation, compliance, and readiness reporting requirements.

Skills

Evaluation of training programs

Exercise design knowledge

Observation and analysis

Documentation and reporting

HSEEP familiarity

U.S. citizenship

Job description

Exercise and Training Evaluator

1099 – Consultant

Various locations within the Commonwealth of Virginia

Position Summary

Applied Training Solutions, LLC is seeking an experienced exercise and training evaluator. The Exercise and Training Evaluator is responsible for assessing the design, delivery, and effectiveness of training programs and operational exercises. This role evaluates participant performance, organizational readiness, and capability outcomes to support continuous improvement, compliance, and preparedness objectives. The Evaluator works closely with planners, instructors, and stakeholders to document strengths, identify gaps, and recommend corrective actions.

Responsibilities

• Observe and evaluate exercises including seminars, workshops, tabletop, functional, and full‑scale exercises in accordance with HSEEP doctrine
• Assess participant performance against exercise objectives, core capabilities, and critical tasks
• Evaluate participant actions, decision‑making, communications, and adherence to plans, procedures, and doctrine
• Use HSEEP‑compliant evaluation tools, including Evaluator Guides, data collection forms, and performance measures
• Apply established evaluation criteria, exercise objectives, and performance measures (e.g., capabilities, core competencies)
• Collect data through observation, evaluator worksheets, interviews, hot washes, and after‑action discussions
• Analyze findings to identify strengths, areas for improvement, and root causes
• Develop After‑Action Reports (AARs) and Improvement Plans (IPs) in accordance with applicable HSEEP standards
• Track corrective actions and support continuous improvement efforts
• Coordinate with exercise planners and training staff to ensure evaluation objectives align with exercise goals
• Maintain objectivity and confidentiality throughout the evaluation process
• Support accreditation, compliance, and readiness reporting requirements
• Maintain accurate logs and records for use in after‑action reporting and future planning

Basic Qualifications

• Experience evaluating training programs, drills, or exercises
• Knowledge of exercise design and evaluation methodologies
• Strong observation, analytical, and documentation skills
• Ability to produce clear, concise, and actionable reports
• Familiarity with Homeland Security Exercise and Evaluation Program (HSEEP)
• Must be a U.S. citizen

Preferred Qualifications

• 5+ years of experience in emergency management or planning roles
• EMA HSEEP training (e.g., IS‑120, IS‑130, IS‑139, or equivalent)
• Experience with core capabilities, THIRA/SPR, or capability‑based planning
• Experience evaluating multi‑agency, multi‑jurisdictional exercises
• Advanced ICSE training (ICS‑300, 400, and E/L/G‑449 or equivalent)
• Knowledge of FEMA, EMAC, and mutual aid coordination processes
• MEPP qualified (Master Exercise Practitioner Program) or demonstrated equivalent experience supporting complex, multi‑agency HSEEP‑compliant exercises

Other Requirements

• U.S. citizenship required: Yes
• Performance location: On‑site while on assignment (various locations within the Commonwealth of Virginia)
• Relocation assistance: Not applicable
• Clearance required: None
• Travel required: Yes – up to 100% while on assignment

Working Environment

The work environment will include EOCs, field sites, or office locations depending on assignment. The position may require extended work hours beyond 12 hours per day, working under high operational tempo, and travel to locations throughout the Commonwealth of Virginia.

Equal Opportunity Employer

Applied Training Solutions, LLC is a leading simulations company providing innovative systems, products, and solutions to government and commercial customers. We are committed to hiring and retaining a diverse workforce. We are an Equal Opportunity Employer and make all employment decisions without regard to race, color, religion, sex, national origin, age, veteran status, disability, or any other protected class. U.S. citizenship is required for most positions.