Our two facilitators will present on their approaches to ensuring their evaluation work is equitable, and then will help us reflect on what we can do to incorporate equity considerations into our evaluation practice. Heidi Schaeffer will present on her work evaluating health equity initiatives and on applying Outcome Harvesting principles to enhance equity and inclusion. Heather Krause will also present on how Feminist data analysis principles present opportunities to increase equity, inclusion, and fairness.
CES Ontario is a sponsor of Eval Cafe Toronto.
The overall purpose of this two day intermediate to advanced level workshop is to focus on how performance measurement frameworks are built, their technical properties, and on how they add value to organizational decision-making. The challenges and limitations of developing performance measurement systems will also be emphasized. The workshop will present current approaches and research based practices in the performance measurement field. It is designed to bring your measures to life and to make performance measurement about transformation and not just about accountability.
The workshop format utilizes formal presentations, interactive exercises, discussions, small group activities, and case studies. Emphasis is placed on the relevance, utility, technical, and practical application of performance measurement. Participants will have an opportunity to apply the theory learned.
The workshop is designed for individuals working in program evaluation, performance measurement, program managers, funders, board of directors. It is designed for both government and not-for-profit/human service delivery sectors.
Specific Learning Objectives:
By the end of the workshop, you should have:
- A consistent approach to measuring organizational performance
- Use of common performance measurement language in your organization
- A specific set of criteria for determining effective performance indicators
- A set of indicators to track efficiency (outputs) & effectiveness (outcomes)
- A set of data collection methods for your performance indicator system
- A framework for developing performance measurement reports/dashboards
- An initial set of appropriate performance targets/expectations
- A positive culture for the use & development of performance measurement
CES Competencies Presented In Workshop:
The following CES competencies are covered in the workshop:
1.1 Knows evaluation theories, models & tools and is informed about new thinking and best practices;
1.7 Uses self-awareness and reflective thinking to continuously improve practice
2.7 Identifies data requirements and data collection tools;
2.6 Uses appropriate evaluation methods;
2.7 Produces balanced evaluation reporting to support decision-making and learning
3.4 Promotes usefulness of evaluation process and results
4.2 Defines work parameters, plans, and agreements;
5.4 Uses a variety of processes that result in negotiated agreements and understandings.
About the Facilitator:
Paul Favaro Ph.D., CE is the Chief of Research, Program Evaluation, and Accountability for the Peel District School Board in Mississauga, Ontario. He teaches management sciences at York University in Toronto.
Dr. Favaro has authored or co-authored articles, chapters, and technical reports, and has conducted professional training workshops in the areas of program evaluation, performance measurement, and research methodology. He is on the editorial board of The Canadian Journal of Program Evaluation. Throughout his career, he has worked as a research consultant to a wide variety of government ministries, educational organizations, charitable foundations, and community-based programs. He has held several executive positions on the board of the Canadian Evaluation Society (CES). In 2010, he was awarded a fellowship in the CES. He is a Credentialed Evaluator by the Canadian Evaluation Society.
This 4-day course was developed by the Canadian Evaluation Society to provide participants with a basic understanding of the main models and practices associated with the profession of evaluation. Prior knowledge of evaluation and of social science research methods is not required. There are no examinations associated with the course, nor is there any homework. Participation in all 15 course modules entitles you to a Certificate of Completion from the Canadian Evaluation Society.
Participants will gain basic levels of knowledge, skill and appreciation with respect to the essential elements of evaluation, equipping them to enter and participate in the evaluation field and develop as evaluation professionals.
Breakfast, lunch, and coffee breaks and included in the registration fee.
Participants will be able to describe in basic terms:
• the uses and benefits of evaluation (1)
• common settings in which evaluation takes place (1)
• where evaluations and performance monitoring fit in the program cycle (1)
• underlying theories related to evaluation, and their implications (1)
• the historical and technical context in which evaluation takes place (1)
• the range of terminology used in evaluation (1)
• causes of, and responses to, resistance (4)
• potential misuses of evaluation (4)
• cultural considerations in conducting evaluations (4)
• ethical considerations with respect to evaluation (6)
• evaluation standards (6)
• evaluation as a profession (9)
• the role of CES, including the CE system (9)
• special applications of evaluation (15)
• the relevance of, and processes associated with:
o identifying evaluation objectives (2)
o identifying and engaging evaluation clients and stakeholders, and establishing roles (2)
o develop a program profile (3)
o creating evaluation questions (5) and indicators (7)
o common data collection methods (8, 10)
o creating an appropriate and valid evaluation design, including the selection of data collection methods (11)
o collecting data, including performance monitoring (12)
o data management (12)
o assessing data quality (12)
o data analysis, including cost effectiveness analysis (12)
o determining evaluation scale and budget (13)
o project management (13)
o synthesis of evidence leading to the development of conclusions and recommendations (14)
o evaluation reporting and dissemination (14)
Participants will also gain elementary experience in:
• creating logic models (3)
• developing indicators (7)
• question construction (5)
• creating an evaluation matrix (11)
• writing findings statements (12)
• creating a reporting plan (14)
About the Facilitator
Dr. Keiko Kuji-Shikatani, C.E., is an internal evaluator with the Ministry of Education, infusing evaluative thinking in collaborative teams to build sector capacity for the use of evidence to inform decisions. She shares her DE expertise widely leading interministerial collaborations, evaluation capacity building for governments both in Canada and internationally, through universities, civil societies and EvalPartners.