Training Evaluation & Performance Specialist

Dynamis, Inc.; Arlington (VA); Hybrid; USD 75,000 - 95,000; Full time

Job summary

Dynamis, Inc. is seeking a Training Evaluation & Performance Specialist to support the U.S. Marshals Service Asset Forfeiture Division in Arlington, VA.

You will design evaluation methods, instruments, and metrics to measure training effectiveness, learner satisfaction, and workplace application. You will analyze data, prepare reports, and collaborate with stakeholders to drive continuous program improvements and evidence-based decisions.

Qualifications

• 5+ years applying formal training evaluation or program evaluation techniques.
• Experience developing evaluation plans and reporting mechanisms.
• Experience applying Kirkpatrick Model or similar frameworks.
• Ability to gather, analyze, and interpret data.
• Strong analytical, written and verbal communication skills.
• Proficiency with Microsoft Office and data analysis tools.

Responsibilities

• Develop evaluation methods to assess training effectiveness and learner satisfaction.
• Apply Kirkpatrick or comparable evaluation frameworks to assess results.
• Develop survey instruments and data collection methods.
• Create performance metrics and reporting mechanisms with dashboards.
• Analyze quantitative and qualitative training data for insights.
• Identify trends and opportunities for program improvement.
• Produce reports and presentations for Government stakeholders.
• Coordinate with curriculum designers and instructors to communicate findings.
• Assist with annual training program reporting and baselines.

Skills

Kirkpatrick Model

Data analysis

Survey development

Reporting

Excel

PowerPoint

Stakeholder communication

Analytical thinking

Education

Bachelor's degree in Education, Adult Education, Curriculum & Instruction, Organizational Development, Program Evaluation, or related field

10 years of related experience in lieu of degree

Tools

Microsoft Excel

Power BI

Survey platforms

Data visualization tools

Job description

Training Evaluation & Performance Specialist

Arlington, VA

Dynamis is seeking an analytical and detail-oriented Training Evaluation & Performance Specialist to support the U.S. Marshals Service (USMS) Asset Forfeiture Division (AFD) in evaluating the effectiveness and overall performance of the USMS AFD Training Program in support of the mission of the Department of Justice (DOJ).

The Training Evaluation & Performance Specialist supports the development and implementation of evaluation methods, survey instruments, assessment tools, performance metrics, and reporting mechanisms used to measure training effectiveness, learner comprehension, learner satisfaction, and application of learning in the workplace.

This position gathers, analyzes, and interprets quantitative and qualitative training data to assess program performance, identify trends, measure year-over-year results, and support continuous improvement of the USMS AFD Training Program. The Training Evaluation & Performance Specialist also assists with preparing recurring and annual reports summarizing training activities, learner outcomes, compliance results, and overall program effectiveness.

The Training Evaluation & Performance Specialist collaborates closely with Government stakeholders, curriculum design personnel, instructors, training administration personnel, subject matter experts, and learners to ensure evaluation activities are aligned with organizational goals, competency requirements, and program priorities.

The successful candidate is an experienced training evaluation professional with demonstrated expertise in performance measurement, survey and assessment development, data analysis, program evaluation, and communicating findings to technical and nontechnical stakeholders.

Location: U.S. Marshals Service Headquarters - Arlington, VA
This position is based in the Washington, DC metropolitan area. Hybrid or telework arrangements may be authorized based on contract requirements and Government approval. Occasional on-site attendance is required to support meetings, curriculum planning sessions, and training initiatives.

Responsibilities:

• Recommend, assist with, and develop evaluation methods to assess training effectiveness, learner comprehension, learner satisfaction, and application of training principles in the workplace.
• Apply established training evaluation frameworks, including the Kirkpatrick Model or comparable evaluation methodologies, to assess learner reaction, learning, behavior, and organizational results.
• Recommend and develop survey instruments, assessment tools, and other data collection methods used to evaluate the USMS AFD Training Program.
• Assist with developing performance metrics, key performance indicators, and reporting mechanisms that illustrate learner and program performance.
• Gather, organize, validate, and analyze quantitative and qualitative data related to training participation, compliance, learner performance, satisfaction, and workplace application.
• Analyze assessment results, examination data, course evaluations, survey responses, and other learner performance information.
• Identify trends, performance gaps, recurring concerns, and opportunities for program improvement.
• Evaluate the effectiveness and efficiency of training activities, instructional approaches, learning resources, and program processes.
• Develop reports, dashboards, presentations, and other reporting products that communicate evaluation results and program performance to Government stakeholders.
• Assist with establishing baselines, benchmarks, success measures, and year-over-year comparisons for the USMS AFD Training Program.
• Provide findings and recommendations that support evidence-based decision-making and continuous improvement of training programs.
• Collaborate with curriculum design personnel and instructors to communicate evaluation findings and recommend areas for curriculum or instructional improvement.
• Collaborate with training administration personnel to obtain accurate enrollment, completion, certification, compliance, and attendance data.
• Assist with drafting and submitting an annual report summarizing training activities and cumulative program results, including the percentage of personnel trained and year-over-year effectiveness and success rates.
• Support completion of the annual training program report no later than sixty days after the end of the fiscal year.
• Maintain evaluation documentation, data files, reporting methodologies, and supporting records in accordance with Government requirements.
• Participate in planning meetings, program reviews, stakeholder discussions, and other contract activities.
• Travel to training locations and support in-person evaluation activities when required by the contract.

Requirements:

• Bachelor's degree in Education, Adult Education, Curriculum and Instruction, Organizational Development, Program Evaluation, or a related field. In lieu of a bachelor’s degree, ten (10) years of directly related professional experience may be substituted.
• Minimum of five (5) years of professional experience applying formal training evaluation, performance measurement, or program evaluation techniques.
• Experience developing evaluation plans, survey instruments, assessment tools, performance metrics, and reporting mechanisms.
• Experience applying the Kirkpatrick Model or comparable training evaluation frameworks.
• Experience gathering, analyzing, and interpreting quantitative and qualitative training data.
• Experience measuring training effectiveness, learner comprehension, learner satisfaction, workplace application, and program outcomes.
• Experience preparing analytical reports, annual program summaries, presentations, dashboards, or other performance-reporting products.
• Experience identifying trends, performance gaps, and opportunities for continuous improvement.
• Demonstrated ability to translate complex data and evaluation findings into clear, actionable recommendations.
• Strong analytical, organizational, research, written, verbal, and interpersonal communication skills.
• Proficiency with Microsoft Office Suite, including Excel and PowerPoint, and other tools used for data analysis, survey administration, visualization, and reporting.
• Ability to obtain and maintain a Moderate Risk Background Investigation.
• Ability to travel is required to support training evaluation activities.

Preferred:

• Graduate degree in Education, Adult Education, Program Evaluation, Organizational Development, Data Analytics, Statistics, Industrial and Organizational Psychology, Public Administration, or a related discipline.
• Experience evaluating training programs for Government agencies, particularly within the Department of Justice (DOJ), Department of Homeland Security (DHS), or other law-enforcement organizations.
• Experience developing and administering surveys, assessments, interviews, focus groups, or other mixed-method evaluation instruments.
• Experience developing key performance indicators, benchmarks, dashboards, and year-over-year performance comparisons.
• Experience analyzing learner performance, examination results, course evaluations, completion rates, certification data, and training compliance information.
• Experience preparing annual training reports or executive-level performance summaries.
• Experience using Microsoft Excel, Power BI, survey platforms, statistical analysis tools, or comparable reporting and visualization technologies.
• Experience supporting enterprise workforce development, organizational learning, or performance-improvement programs.
• Related professional certifications applicable to program evaluation, training measurement, data analytics, performance improvement, or organizational development.

Salary range: $75,000-95,000

The salary range for this position represents the anticipated hiring range. Actual compensation will be determined based on factors such as relevant experience, skills, education, certifications, and potential contract funding.

Voluntary Self-Identification

For government reporting purposes, we ask candidates to respond to the below self-identification survey. Completion of the form is entirely voluntary. Whatever your decision, it will not be considered in the hiring process or thereafter. Any information that you do provide will be recorded and maintained in a confidential file.

As set forth in Dynamis, Inc.’s Equal Employment Opportunity policy, we do not discriminate on the basis of any protected group status under any applicable law.

If you believe you belong to any of the categories of protected veterans listed below, please indicate by making the appropriate selection. As a government contractor subject to the Vietnam Era Veterans Readjustment Assistance Act (VEVRAA), we request this information in order to measure the effectiveness of the outreach and positive recruitment efforts we undertake pursuant to VEVRAA. Classification of protected categories is as follows:

A "disabled veteran" is one of the following: a veteran of the U.S. military, ground, naval or air service who is entitled to compensation (or who but for the receipt of military retired pay would be entitled to compensation) under laws administered by the Secretary of Veterans Affairs; or a person who was discharged or released from active duty because of a service-connected disability.

A "recently separated veteran" means any veteran during the three-year period beginning on the date of such veteran's discharge or release from active duty in the U.S. military, ground, naval, or air service.

An "active duty wartime or campaign badge veteran" means a veteran who served on active duty in the U.S. military, ground, naval or air service during a war, or in a campaign or expedition for which a campaign badge has been authorized under the laws administered by the Department of Defense.

An "armed forces service medal veteran" means a veteran who, while serving on active duty in the U.S. military, ground, naval or air service, participated in a United States military operation for which an Armed Forces service medal was awarded pursuant to Executive Order 12985.

Voluntary Self-Identification of Disability

Form CC-305

Page 1 of 1

OMB Control Number 1250-0005

Expires 04/30/2026

Why are you being asked to complete this form? We are a federal contractor or subcontractor. The law requires us to provide equal employment opportunity to qualified people with disabilities. We have a goal of having at least 7% of our workers as people with disabilities. The law says we must measure our progress towards this goal. To do this, we must ask applicants and employees if they have a disability or have ever had one. People can become disabled, so we need to ask this question at least every five years.

Completing this form is voluntary, and we hope that you will choose to do so. Your answer is confidential. No one who makes hiring decisions will see it. Your decision to complete the form and your answer will not harm you in any way. If you want to learn more about the law or this form, visit the U.S. Department of Labor’s Office of Federal Contract Compliance Programs (OFCCP) website at www.dol.gov/ofccp.

How do you know if you have a disability? A disability is a condition that substantially limits one or more of your “major life activities.” If you have or have ever had such a condition, you are a person with a disability. Disabilities include, but are not limited to:

• Alcohol or other substance use disorder (not currently using drugs illegally)
• Autoimmune disorder, for example, lupus, fibromyalgia, rheumatoid arthritis, HIV/AIDS
• Blind or low vision
• Cancer (past or present)
• Cardiovascular or heart disease
• Celiac disease
• Cerebral palsy
• Deaf or serious difficulty hearing
• Diabetes
• Disfigurement, for example, disfigurement caused by burns, wounds, accidents, or congenital disorders
• Epilepsy or other seizure disorder
• Gastrointestinal disorders, for example, Crohn's Disease, irritable bowel syndrome
• Intellectual or developmental disability
• Mental health conditions, for example, depression, bipolar disorder, anxiety disorder, schizophrenia, PTSD
• Missing limbs or partially missing limbs
• Mobility impairment, benefiting from the use of a wheelchair, scooter, walker, leg brace(s) and/or other supports
• Nervous system condition, for example, migraine headaches, Parkinson’s disease, multiple sclerosis (MS)
• Neurodivergence, for example, attention-deficit/hyperactivity disorder (ADHD), autism spectrum disorder, dyslexia, dyspraxia, other learning disabilities
• Partial or complete paralysis (any cause)
• Pulmonary or respiratory conditions, for example, tuberculosis, asthma, emphysema
• Short stature (dwarfism)
• Traumatic brain injury

PUBLIC BURDEN STATEMENT: According to the Paperwork Reduction Act of 1995 no persons are required to respond to a collection of information unless such collection displays a valid OMB control number. This survey should take about 5 minutes to complete.