Mgr, Quality Evaluation

American Academy of Pediatrics; Itasca (IL); Hybrid; USD 102,105 - 107,777; Full time

Benefits offered by this job

Benefits package

Hybrid schedule

40% office time

Job summary

American Academy of Pediatrics (AAP) seeks a Manager, Quality Evaluation (Grant-funded) to lead evaluation and measurement activities for public health and QI programs. You will design evaluation strategies, create real-time dashboards, and develop data collection methodologies across multiple grant initiatives.

You will translate findings into clear insights for internal and external audiences, supervise data quality, and apply mixed-methods analysis to inform decision-making.

Qualifications

• Bachelor's degree in public health, social science, health science or related discipline required; or equivalent combination of education and work experience.
• Master's degree in related discipline preferred.
• Experience with program evaluation, measurement, and quantitative/qualitative analysis required.
• Experience with database management, data visualization, surveys, and evaluation across public health programs preferred.
• Ability to present complex data clearly to diverse audiences.

Responsibilities

• Design evaluation strategies to assess performance and impact of public health and QI initiatives.
• Design and maintain dashboards and visualizations; develop automated data/reporting frameworks.
• Develop evaluation frameworks, measures, data collection methodologies, and project charters.
• Translate data analyses into actionable insights for internal and external audiences.
• Apply mixed-methods approaches to assess performance, trends, and opportunities for improvement.
• Utilize data platforms (REDCap, PowerBI) for data collection, analysis, and visualization; provide technical assistance.
• Develop data cleaning, standardization, and validation processes; seek automation opportunities.

Skills

Quantitative analysis

Qualitative analysis

PowerBI

REDCap

Atlas.ti

SPSS

SharePoint

Zoom/Teams/WebEx

Project management

Communication skills

Education

Bachelor's degree in public health/related

Master's degree preferred

Tools

REDCap

PowerBI

SharePoint

Job description

TITLE: Manager, Quality Evaluation (Grant-funded)

REPORTING RELATIONSHIP: Manager, Quality Measurement and Evaluation

BASIC FUNCTION:

Manage evaluation and measurement activities for public health and quality improvement (QI) programs at the American Academy of Pediatrics (AAP) and other assigned initiatives, trainings, and grant-funded efforts.

DUTIES AND RESPONSIBILITIES:

1. Design program evaluation strategies to assess performance, implementation, and impact of public health and healthcare QI initiatives.
2. Design and maintain dynamic dashboards and visualizations that track performance, outcomes, and impact in real time across multiple initiatives. Develop automated data and reporting frameworks that connect and integrate multiple data sources, ensuring data quality, consistency, and accuracy to deliver user-friendly dashboards and visualizations.
3. Design, implement, and continuously refine measurement and evaluation strategies for assigned public health, QI, and organizational initiatives. Establish comprehensive evaluation frameworks, performance measures, and data collection methodologies; lead the development of project charters, logic models, key driver diagrams, surveys, and other assessments to generate actionable insights, demonstrate impact, and inform decision‑making.
4. Translate complex data analyses and evaluation findings into clear, actionable insights for diverse internal and external audiences, tailoring communication to drive understanding and action through written reports, presentations, slide decks, dashboards or other deliverables.
5. Analyze and synthesize quantitative and qualitative data using mixed-methods evaluation approaches to assess program performance, identify trends, outcomes, and opportunities for improvement, and generate insights that inform implementation strategies and data-driven decision making.
6. Apply evaluation frameworks and data analytic methods to assess and monitor QI initiatives, providing consultation to staff and participants on interpreting performance data, measuring progress, and refining implementation strategies to improve outcomes. Utilize the data platforms (e.g., REDCap and PowerBI) to collect, manage, analyze, and visualize QI data; lead participant onboarding and provide technical assistance; develop dashboards and reports, and generate data-based recommendations to drive improvement.
7. Develop and implement processes for data cleaning, standardization, and validation to ensure high-quality datasets for evaluation and continuous improvement. Identify opportunities for automation and process improvements to streamline reporting and enhance evaluation efficiency.
8. Develop Institutional Review Board (IRB), Maintenance of Certification (MOC), Continuing Medical Education (CME)applications, as needed.
9. Provide technical assistance to project staff, pediatric practices, and other stakeholders involved in QI and public health initiatives.
10. Collaborate with staff, advisory groups, and subject matter experts to ensure completion of all assigned grant deliverables.
11. Contribute to internal and external reporting, including grant reports, stakeholder updates, and tracking systems.
12. Prepare abstracts, manuscripts, and presentations to disseminate findings at national conferences and through publications.
13. Respond to inquiries from collaborators, AAP staff, clinicians, academic institutions, and other partners regarding program activities.
14. Perform other duties as assigned.

EDUCATION:

Bachelor's degree in public health, social science, health science or related discipline required, or an equivalent combination of relevant education and work experience including some coursework or professional training/certification in program evaluation, measurement, and/or quantitative/qualitative analysis. Master's degree in related discipline preferred.

EXPERIENCE:

At least two years' related experience in program evaluation; public health or social science research; public health program coordination, management, or implementation; quality improvement; and/or health education required. Experience with quantitative/qualitative analysis required. Experience with database management, data visualization, developing or facilitating surveys, and conducting program evaluation across a variety of public health programs is strongly preferred.

ESSENTIAL SKILLS:

Strong technical acumen in quantitative (e.g., SPSS) and qualitative (e.g., Atlas.ti) analysis tools; and data visualization tools (e.g., PowerBI) essential and the ability to learn and apply new technologies including the use of AI. Experience with survey platforms (e.g., REDCap), document collaboration platforms (e.g., SharePoint), and virtual meeting platforms (e.g., Zoom, Teams, WebEx) preferred. Excellent organizational, verbal/written communication, interpersonal, critical thinking, analytical, and project management skills required. Must be able to present complex data in accessible formats for diverse audiences, manage multiple projects, pay close attention to detail, maintain a high level of accuracy, work both independently and as part of a team, take initiative, collaborate effectively with various internal and external constituents, and promote and maintain a positive and cooperative team-oriented work environment with a commitment to fostering a culture where everyone feels valued and respected. Some travel and evening/weekend work may be required, along with the need for flexibility in arranging work schedule to accommodate physicians' availability.

A reasonable estimate of the current base pay range for this position is $102,105.27 - $107,777.80. Compensation decisions take into account a wide range of factors, including but not limited to relevant experience, skills, certifications, geographic location, business needs, and organizational policies. In addition to those factors, we believe in the importance of pay equity and consider internal equity of our current team members as a part of any final offer. Hiring at the maximum of the range would not be typical. We also offer a comprehensive benefits package which includes healthcare and retirement savings plans.

Hybrid work environment of 40% of work time in the office per month.

The AAP offers an excellent work environment, competitive salary, and a comprehensive benefits package. As a reaffirmation to our employee-focused culture, since 2005 the AAP has been named one of the 101 Best and Brightest Companies to Work for in the Chicagoland area. Additionally, we are an Equal Opportunity Employer of Minorities, Females, Individuals with Disabilities, and Veterans that values the strength diversity brings to our workplace.

Reasonable Accommodation: Individuals with a disability in need of a reasonable accommodation in connection with the job application process may contact us at 630-626-6297 or [e-mail]. Please note, only those inquiries concerning a request for reasonable accommodation will receive a response.