Upcoming Events:

Strategic Project Management for Evaluators
Facilitator: Alison Paprica
October 7, 2020
Registration is now closed.

The sheer volume of guidance in the PMBOK® Guide and other project management resources can make it challenging for evaluators to know which project management tools to prioritize, and when and how to apply them. To paraphrase Tommy Lasorda, the effective management of an evaluation project is like ‘holding a dove – you need to hold it tightly enough that it doesn’t fly away, but not so tightly that you crush it.’ This online workshop provides theory and hands-on experience applying light-touch project management tools that have been tailored for evaluation projects.

By the end of the three-hour online workshop, participants will be able to:

· Describe how the project management mindset of “define then deliver” can be applied to evaluation projects.

· Construct a work breakdown structure (WBS) to articulate the scope of a project in terms of concrete deliverables.

· Describe how the deliverables in a WBS can be used as the foundation for schedule and budget development.

· Implement deliverable-based project monitoring and control using a simple tracking sheet.

This project management workshop aligns directly with CES competency 4.0: Management Practice. The workshop aims to support program evaluators with foundational skills and tools that help manage projects/evaluations such as work plans, coordinating accountabilities and resources (including budget) at outlined in the CES Competencies for Canadian Evaluation Practice. The workshop also supports CES competency 2.0: Technical Practice.

Participants should have a computer with Microsoft PowerPoint and Excel (or equivalent) loaded.

Past Events:

Developmental Evaluation in Action: Facilitating Social Innovation in Real-Time
Facilitators: Dr. Keiko Kuji-Shikatani, Dr. Wendy Rowe, and Megan Borner

January 29-30, 2020
Hart House, University of Toronto, Toronto

November 28 and December 4-5, 2018
Bond Place Hotel, Toronto

November 13 and 15-16, 2017
Bond Place Hotel, Toronto

This blended course provides participants with introductory knowledge in the fundamentals of Developmental Evaluation (DE) and its implementation, including the role and use of the Theory of Change/Action.

The course is focused on how developmental evaluators track, document, and help interpret the nature and implications of innovations and adaptations as they unfold, and help extract lessons and insights from both processes and outcomes to inform the ongoing adaptive innovative process. (Patton, McKegg, & Wehipeihana, 2015)

Situational analysis and case studies will be used to authenticate the information being presented in order to equip evaluators with the practical application of DE within the complex, dynamic environments they may experience in their work.

Throughout the course participants will be invited to apply their learning to the programs/ evaluation activities in which they are involved.

The course will consist of a webinar and in-person session. An optional one-hour group consultation is offered to those participants wishing to present and discuss questions or issues concerning implementation of DE they may have.

Performance Measurement: From Theory to Practice
Facilitator: Dr. Paul Favaro

September 16-17, 2019
(Rescheduled from June 20-21, 2019)
Oakham House, Ryerson University

The overall purpose of this two day intermediate to advanced level workshop is to focus on how performance measurement frameworks are built, their technical properties, and on how they add value to organizational decision-making. The challenges and limitations of developing performance measurement systems will also be emphasized. The workshop will present current approaches and research based practices in the performance measurement field. It is designed to bring your measures to life and to make performance measurement about transformation and not just about accountability.

The workshop format utilizes formal presentations, interactive exercises, discussions, small group activities, and case studies. Emphasis is placed on the relevance, utility, technical, and practical application of performance measurement. Participants will have an opportunity to apply the theory learned.

The workshop is designed for individuals working in program evaluation, performance measurement, program managers, funders, board of directors. It is designed for both government and not-for-profit/human service delivery sectors.

Learning Objectives:

By the end of the workshop, you should have:

  1. A consistent approach to measuring organizational performance
  2. Use of common performance measurement language in your organization
  3. A specific set of criteria for determining effective performance indicators
  4. A set of indicators to track efficiency (outputs) & effectiveness (outcomes)
  5. A set of data collection methods for your performance indicator system
  6. A framework for developing performance measurement reports/dashboards
  7. An initial set of appropriate performance targets/expectations
  8. A positive culture for the use & development of performance measurement

CES Competencies Presented In Workshop:

This workshop aims to strengthen capacities in line with the following Competencies for Canadian Evaluation Practice:

Reflective Practice
1.1 Knows evaluation theories, models & tools and is informed about new thinking and best practices;
1.7 Uses self-awareness and reflective thinking to continuously improve practice

Technical Practice
2.6 Uses appropriate evaluation methods;
2.7 Identifies data requirements and data collection tools;
2.7 Produces balanced evaluation reporting to support decision-making and learning

Situational Practice
3.4 Promotes usefulness of evaluation process and results

Management Practices
4.2 Defines work parameters, plans, and agreements;

Interpersonal Practice
5.4 Uses a variety of processes that result in negotiated agreements and understandings.

The Art and Science of Producing Effective Infographics
Facilitator: Dr. Sid Ali

September 29, 2020

May 27, 2020

March 29, 2019
Bond Place Hotel, Toronto

September 28, 2018
Li Ka Shing Knowledge Institute, Toronto

Data visualization as a hot topic in the evaluation world, especially in knowledge transfer activities. The interactive and multi-modal workshop will focus on a specific type of data visualization, namely infographics – artistic or graphic presentation of data to communicate insights. We will briefly orient infographics in the realm of data visualization, illustrating the different types of infographics. Then our focus will shift to the science of why we use infographics in communicating to our various audiences (clients and funders). We then venture into design theory, calling on the works of data visualization experts Bernard Marr, Stephanie Evergreen, Garr Reynolds and Edward Tufte. The bulk of the time will be aimed at specific design elements of graphics, colour, and font, which provide the visual cues to our most important element: the data. We will then put these elements together with examples, and then look at resources and tools for infographic production. The session will conclude with a short question period.

Learning objectives:
By the end of the Workshop, the participant will be able to:

  1. Compare the different types of infographics and situate them in the greater web of data visualization
  2. Understand the basic tenets of design theory and how the brain process and information
  3. Identify and appraise the design elements of effective infographics
  4. Locate and use various resources and tools for effective infographic production

In addition, this workshop aims to strengthen capacities in line with the following Competencies for Canadian Evaluation Practice:

2.8 Identify data sources
2.13 Assesses trustworthiness of data
2.16 Reports evaluation findings and results
3.5 Serves the information needs of intended users
4.6 Reports on progress and results
5.1 Uses written communication skills and technologies


Strategic Project Management for Evaluators
Facilitator: Alison Paprica

October 12, 2018
Bond Place Hotel, Toronto

April 6, 2017
Bond Place Hotel, Toronto

The sheer number of tools and processes in the Project Management Body of Knowledge (PMBOK® Guide) can make it challenging for evaluators to know which tools to apply, and when. This workshop provides theory and hands-on experience applying four PMBOK® derived light-touch project management tools that have been tailored for evaluation projects. All tools can be applied using the standard Microsoft Office suite of applications.

Participants will work with two case studies used to illustrate project management in practice, with time for participants to share their own learnings and experiences. The workshop concludes with a facilitated session using a modified version of the PMBOK® risk management processes to help participants identify, and begin to develop mitigation strategies for, the risks most likely to affect evaluation projects. The course will enhance participant knowledge and application of project management tools and processes that have been tailored for evaluators, with a focus on:

  • Understanding the project management mindset of “define then deliver”
  • Hands-on experience applying light-touch project management tools and processes; specifically:
    • Work breakdown structure
    • Deliverable-based Gantt chart schedule
    • Deliverable-based budget
    • Deliverable-based project tracking and reporting
  • Sharing experience and knowledge on the topic of common risks for evaluation projects

This course presupposes a basic understanding of evaluation theory and practice, and is best suited for those with a firm grounding in its evaluation concepts.

Beyond Boxes – Black, Mystery and Magic – Understand and Use the Theory of Change for Your Programs
Facilitators: Jennifer Yessis and Kelly Skinner

March 9-10, 2017
Centre for Social Innovation – Regent Park, Toronto

Theory of Change describes the theory (or set of assumptions) that explain the steps that lead to the long-term goal of interest and the connections between program activities and outcomes.

This advanced two-day workshop will describe concepts related to theory of change, and apply the concepts discussed to enable participants to develop program theory including theory of change and action.

The concept of contribution analysis will be described in day two, and applied to the theory of change example. Participants will be engaged throughout the two-day workshop in interactive activities for an active learning experience.

At the end of the workshop, participants will be able to:

  • Describe and explain what a program theory is, and how this relates to theory of change and theory of action
  • Describe how theories of change go beyond logic models
  • Describe how theories of change can contribute to a contribution analysis
  • Apply the theoretical concepts shared to develop a program theory for a relevant program including a theory of change and theory of action