The Methods Masterclass session will be held from 1:15 PM—2:15 PM on Tuesday May 11, 2021. Pre-selection is required. Speaker bios can be found here. This session includes the following four concurrent classes; additional sessions may be added:


Learning Outcome Harvesting (OH) Experientially
Facilitator: Heidi Schaeffer

Outcome Harvesting (OH) is a participatory monitoring and evaluation tool inspired by Outcome Mapping and Utilization Focused Evaluation. OH is used to collect (harvest) evidence of what has changed (outcomes) and, then, working backwards, to determine whether and how an intervention has contributed to these changes. It is being used worldwide to robustly identify, describe, analyse and interpret outcome-level results regardless of whether they were pre-defined. Outcome Harvesting has proven to be especially useful in complex situations when it is not possible to define concretely most of what an intervention aims to achieve, or even, what specific actions will be taken over a multi-year period. Its use helps ensure outcome-level monitoring and evaluation is firmly and transparently based on credible evidence as defined by the needs of primary users. 

Learning Objectives:
1. Participants will be introduced to the concepts behind Outcome Harvesting and its 6 Design steps. 
2. Participants will learn how to identify outcomes and possible outcomes from documents and survey data. 
3. Participants will learn to formulate verifiable outcome statements.  
4. Participants will reflect on the value and applicability of Outcome Harvesting to their work.

Credentialed Evaluator (CE) Competencies:
1.1 Knows evaluation theories, models, methods and tools and stays informed about new thinking and best practices.
2.5 Develops evaluation designs. 
3.2 Identifies stakeholders needs and their capacity to participate, while recognizing, respecting, and responding to aspects of diversity. 
 


Five Quick and Easy Tips for Better Data Visualization 
Facilitator: Dr. A. Sidiq (Sid) Ali

Participants will learn five quick and easy tips to improve their data visualization. Using Microsoft Excel and focusing on charts, participants will be shown how to use simple techniques to improve the overall clarity of the messaging of the charts, as well as their aesthetic appeal. 

Learning Objectives:
1. Participants will be able to better craft the overall message from their charts.
2. Participants will be able to better highlight the salient information in their charts.
3. Participants will be able to choose the appropriate chart type for their data.

Credentialed Evaluator (CE) Competencies:
2.8 Collects, analyzes and interprets data using appropriate methods. 
3.4 Promotes and facilitates usefulness of the evaluation process and results. 
5.2 Demonstrates effective and appropriate written and visual communication skills. 


Performance Measurement: From Theory to Practice to Transformation 
Facilitator: Dr. Paul Favaro

We will be “Learning by Doing” as the “Performance Measurement” session unfolds. Participants wiil be asked to complete a “Transformational Performance Measurement Questionnaire” before the session. Topics covered in the session will include: an overview of the current state of performance measurement; performance measurement as organizational learning; the elusive search for the secrets of successful performance measurement; identifying when and why measurement goes bad; the major causes of measurement dysfunction; and how to change the performance measurement paradigm from one of accountability to one of transformation. The overall purpose of the session is for us to begin the process of how we rethink the way we measure and drive organizational success. Above all else, performance measurement should enable us to  transform our work and organization by taking purposeful action based on knowledge. 

Learning Objectives:
1. Participants will be able to create an optimal environment for the effective use of performance measurement. 
2. Participants will be able to create the social and organizational context to make measurement enjoyable, productive, and transformational.  
3. Participants will be able to identify the major causes of measurement dysfunction.

Credentialed Evaluator (CE) Competencies:
1.1 Knows evaluation theories, models, methods and tools and stays informed about new thinking and best practices. 
2.4 Frames evaluation topics and questions. 
2.5 Develops evaluation designs. 
3.2 Identifies stakeholders’ needs and their capacity to participate, while recognizing, respecting, and responding to aspects of diversity. 
3.4 Promotes and facilitates usefulness of the evaluation process and results. 
4.1 Provides leadership to the evaluation project. 
4.6 Communicates project progress to all concerned. 
5.1. Uses communication strategies appropriate to the cultural, linguistic, social, and political context. 
5.5 Builds partnerships within the evaluation context. 


Visual Methods for Developmental Evaluation and Learning
Facilitator: Dr. Cameron Norman

This interactive session will explore a variety of tools and strategies to help facilitate the evaluation of programs with high levels of complexity and innovation associated with them. A variety of interactive tools and approaches will be profiled to help evaluators document innovations, improve learning, and connect evaluation data, design choices, and decisions together. The workshop is designed for those working in complex program contexts who are looking for new ways to organize, present, share, and develop insights from multiple streams of data, particularly those interested in Developmental Evaluation or working in highly innovative programs.

Learning Objectives:
1. Participants will identify visual tools that can make evaluation data more accessible to different stakeholders.
2. Participants will understand the role that visual methods can play in organizing and making us of complex, changing data.

Credentialed Evaluator (CE) Competencies:
2.5 Develops evaluation designs. 
2.7 Identifies data requirements, sources, sampling, and data collection tools. 
3.4 Promotes and facilitates usefulness of the evaluation process and results.


Expanding Online Data Collection Beyond Surveys 
Facilitator: Marshal Rodrigues

Are you experiencing survey fatigue? Do you want to expand your data collection methodologies but not sure where to start? Has the lack of in-person data collection during COVID impacted your ability to capture participants’ stories? This interactive session will introduce you to two free online data collection tools, Photovoice and online whiteboards, that allow you expend your existing practices to learn participants’ stories and experiences both inside and outside of the program. The session will cover the benefits and limitations of each methodology, how to best set it up and how it can be best integrated into your evaluation approach. 

Learning Outcomes:
1. Participants will use appropriate evaluation methods.
2. Participants will collect, analyze and interpret data using appropriate online methods.

Credentialed Evaluator (CE) Competences:
2.6 Uses appropriate evaluation methods. 
2.8 Collects, analyzes and interprets data using appropriate methods. 
2.9 Uses findings to answer evaluation questions and, where appropriate, to develop recommendations.