Program Evaluation Lead - Evidence & Impact Analyst

LMI Consulting, LLC; Tysons (VA); Hybrid; USD 165,000 - 200,000; Full time

Benefits offered by this job

Hybrid work model

Onsite 25% presence

Job summary

LMI is seeking a Research Analyst/Program Evaluation Lead to strengthen evidence and decision quality across VA modernization initiatives. The role sets evaluation standards, baselines, and interpretation approaches for outcomes across operational, clinical, adoption, workforce, and technology domains.

The ideal candidate will design credible approaches within federal data realities, distinguish activity from outcomes, and communicate limitations clearly to senior decision-makers.

Qualifications

• Bachelor's degree in a quantitative field.
• 10+ years in program evaluation or related fields.
• Experience designing baselines, measurement frameworks, and defensible evidence standards.
• Ability to understand uncertainty, bias, confounding, and causal limitations.
• Certification: PMP or Lean Six Sigma Green Belt recommended.
• VA vetting and data-handling requirements.
• Ability to distinguish attribution, contribution, and observed outcomes for leaders.

Responsibilities

• Define evaluation frameworks, baselines, comparison approaches, evidence thresholds, and decision criteria.
• Review measurement plans for data fitness, denominators, feasibility, bias, confounding, and methodological soundness.
• Distinguish observed results from projected benefits and communicate uncertainty without overstating causal claims.
• Design before/after, quasi-experimental, mixed-methods, and other fit-for-purpose evaluation approaches.
• Integrate operational, clinical, adoption, workforce, technical, and user experience measures into coherent evidence.
• Partner with data staff on analytical execution while retaining responsibility for evaluation rigor and interpretation.
• Translate findings into decision-ready options for continue, adjust, retest, scale, defer, or stop decisions.
• Create reusable evaluation templates, standards, and review criteria for future VA work.
• Frame evaluation questions, logic models, outcome hypotheses, measures, data requirements, comparison strategies, and interpretation rules before implementation.
• Review sampling approaches, denominator logic, missingness, confounding, selection effects, measurement bias, and other threats to validity.
• Develop fit-for-purpose data-collection and mixed-methods plans that connect quantitative results with user, implementation, operational, and contextual evidence.
• Conduct or direct sensitivity analyses and alternative interpretations when evidence is uncertain.

Skills

Uncertainty analysis

Technical writing

Education

Bachelor's degree in a quantitative field

Master's or doctoral degree in a quantitative field

Tools

Python, R, SAS, SQL

Job description

LMI is seeking a Research Analyst/Program Evaluation Lead to strengthen evidence and decision quality across VA modernization initiatives. The role sets evaluation standards, baselines, and interpretation approaches for outcomes across operational, clinical, adoption, workforce, and technology domains.

The ideal candidate will design credible approaches within federal data realities, distinguish activity from outcomes, and communicate limitations clearly to senior decision-makers.