2018 UNEG Evaluation Week - Professional Development Seminar

Overview

A one-day Professional Development Seminar will be organized on the first day of the UNEG week for all participants of the EPE. The purpose of the seminar is to provide training to participants on topics which emerged as highly useful in evaluation work, based on the UNEG members’ survey.

The seminar will consist of four parallel topics, and each topic will run through the entire day. The topics selected are:

Topic 1 - Approaches to Impact Evaluation:

This 1-day workshop aims to provide an opportunity to discuss recent methodological developments in experimental and quasi-experimental IEs within the increasingly complex development and humanitarian contexts we work. Have things changed or are we getting better at creatively applying IE methods in the field?

In situations where conditions are not perfect, how can experimental or quasi-experimental IEs be undertaken, and should they be undertaken or alternative methods used? What does a good impact evaluation design look like - what components does it need to succeed in answering the questions?

The day starts with recap of impact evaluation, and what it can be used for, moving to examples of creative quasi-experimental impact evaluations, with an afternoon of group work for delegates to discuss and design different IE plans around real examples.

Topic 2 - Data visualization tools:

The ‘Data Visualization and Infographic Design’ 1-day workshop aim to provide delegates with an accessible and comprehensive introduction to data  visualization and infographic design.

The focus of the training is to teach the craft of this discipline, helping delegates to know what to think, when to think about and how to resolve all the analytical and design decisions involved in any data-driven challenge.

The workshop is structured around a proven design workflow. Across the session delegates will build up, stage by stage, a detailed understanding of all the different aspects of decision-making that goes into any data visualization or infographic design work.

The content is delivered through a blend of teaching, discussion, and group practice. The practical exercises vary in nature from evaluating work, conceiving ideas, and forensically assessing design choices.

The approach to teaching this subject is not framed around specific tools or applications. Across the session there will be references for some of the most common, contemporary technologies but the emphasis is on the underlying craft, regardless of your tools or skills.

Materials will be issued digitally (eg. Dropbox/USB flash drive) covering all teaching content, exercise files and useful resources. Attendees are required to bring fully-charged laptops to use as a convenient workspace for the session. The only software requirements are Excel, a browser and pdf reader, no other technical or skill-based prerequisites exist.

Topic 3 - An introductin to the practice of SenseMaker:

Sensemaker is an innovative narrative-based research, monitoring and decision-making methodology designed to generate actionable insights and guide interventions in complex systems and processes. SenseMaker is based on the collection and indexing of fragmented material including personal experiences, pictures, reports, blogs and other forms of data.

This one-day seminar is an introduction to the SenseMaker methodology. It is designed for participants that want to understand the principles and practice of SenseMaker and how it can be used in design, monitoring and evaluation of complex international development programmes. In this practical and interactive workshop, participants will be introduced to the different steps of the SenseMaker process and will understand how SenseMaker can generate (real-time) feedback to track progress and inform meaningful interventions. Throughout the workshop examples and experiences from different SenseMaker projects will be presented. 

The workshop will be delivered and facilitated around the following core themes:

• The principles and the background of the SenseMaker methodology.
• The design steps of a SenseMaker project
• The data collection process
• The analysis process
• Examples of the use of SenseMaker for monitoring and evaluation

Topic 4 - Ethics in evaluation:

Workshop Purpose: To explore current understanding and practice with regard to application of ethics in evaluation and to map out how we might improve our practice moving forwards.

Workshop objectives: This workshop will be a success if all participants:

• Have explored expectations regarding application of ethics in the management of evaluations.
• Have explored where we are at the moment with regard to applying ethics in the management of our evaluations, including sharing initial reflections on gaps in current practice.
• Share a common understanding of what 'good' ethical management of evaluations looks like, throughout the entire evaluation management process.
• Are clear of our own role and shared roles in enhancing the ethical management of evaluations.
• Have mapped out next steps for moving forward.

Workshop outputs:

• Participants have a better understanding of practice, both internal and external, with regard to ethics in evaluation.
• UN Evaluation colleagues have a set of next steps for taking forward ethics in their evaluations.
• Participants have a clear set of commitments for moving forward to enhance consideration of ethics in evaluation.
• Participants have an enhanced sense of collective responsibility, understanding of and engagement with ethics in evaluation.
• The UN Ethics Task Force has inputs to inform a clear set of deliverables for 2018.

This workshop will be facilitated, informal and participative. The intention is to co-create our learning through open discussions and sharing of participant experiences and questions.

The 2018 Evaluation week will take place in Rome between 7th and 11th May and is organized with the support of the Rome-based UNEG member organizations: FAO, IFAD and WFP. The 2018 Evaluation Week will include three main components, Please click below links to view more information:-

• Professional Development Seminar (7 May 2018)                   

• Evaluation Practice Exchange (EPE) (8-9 May 2018)                            

• UNEG Annual General Meeting (AGM) (10-11 May 2018)

Event Details