This 4-day course was developed by the Canadian Evaluation Society to provide participants with a basic understanding of the main models and practices associated with the profession of evaluation. Prior knowledge of evaluation and of social science research methods is not required. There are no examinations associated with the course, nor is there any homework. Participation in all 15 course modules entitles you to a Certificate of Completion from the Canadian Evaluation Society.
Participants will gain basic levels of knowledge, skill and appreciation with respect to the essential elements of evaluation, equipping them to enter and participate in the evaluation field and develop as evaluation professionals.
Participants will be able to describe in basic terms:
• the uses and benefits of evaluation (1)
• common settings in which evaluation takes place (1)
• where evaluations and performance monitoring fit in the program cycle (1)
• underlying theories related to evaluation, and their implications (1)
• the historical and technical context in which evaluation takes place (1)
• the range of terminology used in evaluation (1)
• causes of, and responses to, resistance (4)
• potential misuses of evaluation (4)
• cultural considerations in conducting evaluations (4)
• ethical considerations with respect to evaluation (6)
• evaluation standards (6)
• evaluation as a profession (9)
• the role of CES, including the CE system (9)
• special applications of evaluation (15)
• the relevance of, and processes associated with:
o identifying evaluation objectives (2)
o identifying and engaging evaluation clients and stakeholders, and establishing roles (2)
o develop a program profile (3)
o creating evaluation questions (5) and indicators (7)
o common data collection methods (8, 10)
o creating an appropriate and valid evaluation design, including the selection of data collection methods (11)
o collecting data, including performance monitoring (12)
o data management (12)
o assessing data quality (12)
o data analysis, including cost effectiveness analysis (12)
o determining evaluation scale and budget (13)
o project management (13)
o synthesis of evidence leading to the development of conclusions and recommendations (14)
o evaluation reporting and dissemination (14)
Participants will also gain elementary experience in:
• creating logic models (3)
• developing indicators (7)
• question construction (5)
• creating an evaluation matrix (11)
• writing findings statements (12)
• creating a reporting plan (14)
About the Tickets
Please note that CES New Practitioner, CES Student, and CES 60+ tickets are available only to CES members with those membership categories. If you are unsure about your membership category, or would like more information about how to become a member, please contact CES Ontario.
About the Facilitator
John Allen has worked in the area of Program Evaluation, Performance Measurement and Strategic Planning for more than 35 years, serving on governments at the national, provincial / state and municipal levels in Canada and the United States as well as the not-for-profit sector. Before becoming a consultant John was an Ontario public servant with the Treasury Board Secretariat and the Ministry of Municipal Affairs and Housing. While with Treasury Board, John implemented Ontario’s first formal performance measurement and evaluation process, Managing By Results. That system remains the conceptual framework of Ontario’s results based management initiatives to this day.
John works on client projects on his own and in partnership with Power Analysis Inc. of London, Ontario. As well as undertaking project assignments in all his areas of speciality, John also provides training on those subjects. He is a vendor of record with the provinces of Ontario, Nova Scotia, Manitoba, British Columbia, the Federal government and Nunavut Territory. He is an instructor for the Canadian Evaluation Society, the Association of Municipal Managers, Clerks and Treasurers of Ontario and the Ontario Municipal Social Services Association.
John is an instructor in public sector management topics with the University of Alberta’s School of Business, the Sprott School of Business at Carleton University and the Schulich School of Business at York University.
Developmental Evaluation in Action: Facilitating Social Innovation in Real-time consists of three parts:
Online webinar: TBA
In-person: Wednesday January 29, 2020 & Thursday January 30, 2020. Registration is 8:30 AM – 9 AM on January 29; instruction is 9 AM – 4 PM. Refreshments will be provided.
On-line group consultation (optional): TBA
This blended course provides participants with introductory knowledge in the fundamentals of Developmental Evaluation (DE) and its implementation, including the role and use of the Theory of Change/Action.
The course is focused on how developmental evaluators track, document, and help interpret the nature and implications of innovations and adaptations as they unfold, and help extract lessons and insights from both processes and outcomes to inform the ongoing adaptive innovative process. (Patton, McKegg, & Wehipeihana, 2015)
Situational analysis and case studies will be used to authenticate the information being presented in order to equip evaluators with the practical application of DE within the complex, dynamic environments they may experience in their work.
Throughout the course participants will be invited to apply their learning to the programs/ evaluation activities in which they are involved.
The course will consist of a webinar and a two-day in-person session. An optional one-hour group consultation is offered to those participants wishing to present and discuss questions or issues concerning implementation of DE they may have.
Please note that this course requires the use of Michael Quinn Patton’s book Developmental Evaluation Exemplars: Principles in Practice (2015). This book can be purchased directly from Guilford Press here.
Megan Börner has worked in the public education sector for over 25 years. She is currently with the Ontario Ministry of Education, where she has created a model for embedding internal research and evaluation staff in policy/program teams to promote the understanding of evaluative thinking through everyday decisions and processes.
Dr. Keiko Kuji-Shikatani, C.E., is an internal evaluator with the Ministry of Education, infusing evaluative thinking in collaborative teams to build sector capacity for the use of evidence to inform decisions. She shares her DE expertise widely leading interministerial collaborations, evaluation capacity building for governments both in Canada and internationally, through universities, civil societies and EvalPartners.
Dr. Wendy Rowe is a professor at Royal Roads University, Victoria, Canada, teaching in the School of Leadership. She has 20 years professional experience in the evaluation field across Canada and United States, using models of collaboration and developmental evaluation to enhance organizational capacities, increase program efficiency and effectiveness, and create learning organizations.