Evaluation Specialist

OntarioMD Inc.; Toronto; Hybrid; CAD 68,000 - 72,000; Full time

Benefits offered by this job

Hybrid working model

Best Places to Work

Job summary

OntarioMD Inc. is seeking an Evaluation Specialist for a 6-month contract in a hybrid setup.

You will plan, implement, and report on evaluations of clinician experience with digital health technologies, collaborating with cross-functional teams and external partners to support evidence-informed decisions. The role requires a Master’s degree and 3–5 years of experience in program evaluation within healthcare, with strong data collection and analysis skills.

Qualifications

• Master's degree in a related field (e.g., Public Health, Epidemiology, Health Informatics, Health Sciences, Evaluation, Health Policy, Health Administration, Social Sciences or Statistics).
• 3–5 years of experience in program evaluation, performance measurement, health research, or health system analysis.
• Experience evaluating healthcare delivery environments.
• Experience working with diverse stakeholders in healthcare or a related environment.

Responsibilities

• Plan and design fit-for-purpose evaluations for digital health pilots and implementations.
• Identify evaluation questions, indicators, data sources and methodologies.
• Design data collection tools (surveys, interview guides, focus group guides).
• Analyse qualitative and quantitative data; interpret findings.
• Prepare reports, briefs, and actionable recommendations for leadership and partners.

Skills

Research skills

Survey tools

Ontario health sector

Collaboration

Attention to detail

Education

Master's degree

Job description

Evaluation Specialist Contract (6 months), Hybrid

The Evaluation Specialist will be assigned to specific projects where they will be responsible for planning, implementation, and reporting on evaluations of clinician experience with the digital health technologies used in clinical practices. This role works collaboratively within a team of subject matter experts and cross-functionally to address evaluation needs for different projects and programs, including those conducted in partnership with Ontario health sector organizations, to generate evidence that supports continuous improvement, accountability, informed decision-making, and thought leadership.

Reporting to the Manager, Policy, Evaluation & Corporate Performance, the Evaluation Specialist is responsible for:

Evaluation Planning and Design:

• With some responsibility for project leadership, collaborate on the design and conduct of fit-for-purpose evaluations for digital health pilots, implementations, and assessments in clinical practices.
• Identify evaluation questions, theories of change (or logic models), indicators, data sources, and methodologies for each project.
• Ensure evaluations align with organizational priorities, strategic objectives, and funding requirements.

Data Collection and Analysis:

• Design data collection tools, including surveys, interview guides, focus group guides, and tools to support additional methods as required.
• Analyse qualitative and quantitative data to identify and interpret findings.
• Ensure methods align with best practice by remaining current with the literature.
• Adhere to data privacy and security requirements, including establishing informed consent and permission to collect information (e.g. recording, sharing) from evaluation participants.

Reporting and Knowledge Translation:

• Prepare evaluation reports, presentations, and briefing materials.
• Translate complex findings into clear and actionable recommendations for diverse audiences.
• Present evaluation results to senior leadership and external partners as required.
• Support knowledge mobilization and evidence-informed decision-making.

Engagement:

• Collaborate with internal colleagues and external partners to execute evaluation plans.
• Facilitate evaluation planning activities such as workshops and consultations.
• Contribute to organizational evaluation uptake and capacity through participating in internal knowledge-building presentations and training as directed by Manager.

Project Management:

• Collaborate with organizational project manager to build and monitor project plans, timelines, and accountabilities.
• Coordinate with external consultants, research partners, or evaluation teams as required.
• Ensure timely completion of deliverables.

Requirements that are important to us:

Education & Experience:

• Master's degree in Public Health, Epidemiology, Health Informatics, Health Sciences, Evaluation, Health Policy, Health Administration, Social Sciences, Statistics, or a related field.
• Three (3) to five (5) years of experience in program evaluation, performance measurement, health research, or health system analysis.
• Experience evaluating healthcare delivery environments.
• Experience working with diverse stakeholders in healthcare or a related environment.

Knowledge:

• Evaluation standards and best practices, specifically in project and program evaluation.
• Privacy legislation and ethical research principles.

Skills & Competencies:

• Strong research skills to complement existing organizational subject matter expertise in quantitative analytics and qualitative methodologies.
• Experience with survey tools and fit-for-purpose report development.
• Understanding of the Ontario health sector.
• Experience conducting research related to any of these areas considered an asset: clinical workflow, digital health usability, healthcare provider experiences.
• Collaboration and relationship building.
• Attention to detail.

What we offer:

Base salary range of $68,000 - $72,000 annually; final compensation will be determined based on experience, skill set, education, training, and internal equity.

• Fun, friendly, and dynamic work environment with a passion for digital health.
• Hybrid working model.
• Fantastic opportunity to grow within the team and throughout the organization.
• An organization recognized as one of the Best Places to Workby HRD Canada for two consecutive years.

OntarioMD is strongly committed to diversity within its community and welcomes applications from racialized persons/persons of colour, women, Indigenous People of North America, persons with disabilities, LGBTQ2S+ persons, and others who may contribute to the further diversification of ideas. In accordance with the AODA, accommodation will be provided throughout the recruitment process to applicants with disabilities.

Do you currently work at OntarioMD or the OMA?*

Were you referred to this position?*

If you were referred by an OntarioMD employee, please provide us with the name of the person who referred you to this position.

Do you have any immediate family members currently working at OntarioMD? (Immediate = spouse, sibiling, parent)*

Are you currently located in Ontario, Canada?*