International Civil Aviation Organization

Evaluation Function

The Evaluation function of ICAO is part of the Office of Internal Oversight (OIO).  The mandate of OIO is to assist the Secretary General in ensuring that ICAO is managed effectively, efficiently and economically, and in conformity with the applicable regulations and rules, and to provide him/her with independent and objective assurance, advice, insight and foresight through performing internal audits, evaluations, and other oversight assignments. OIO is also mandated to act as focal point for the Joint Inspection Unit (JIU) and in relation to the audits of the External Auditor. Additionally, OIO provides secretariat services to the Evaluation and Audit Advisory Committee (EAAC).

The purpose, authority and responsibilities of OIO are defined in the OIO Charter. The ICAO Evaluation Policy, approved by the ICAO Council in 2021, complements the Charter, and further defines the aims, principles, and planning process of the evaluation function, as well as its role in decentralized evaluations and quality assurance.The evaluation function is composed of the Chief, (C/OIO), one Evaluation Specialist and one Evaluation Officer. C/OIO reports administratively to the ICAO Secretary General and functionally to the ICAO Governing Body (the Council). OIO’s annual and triennium plans are approved by the ICAO Council to which OIO presents its annual report. OIO's evaluation expenditure not related to staffing (consultancy and mission travel) during 2022 was approximately CAD 125,000. There is no dedicated decentralized evaluation staff. Nevertheless, some organizational units attempt to conduct decentralized evaluations. OIO intends to offer support to such evaluations, within the limits of its capacity. 

Promoting a culture of evaluation in-house

OIO staff members participate in outreach activities in order to raise awareness among staff on the role of evaluation function at ICAO. OIO also provides informal briefings to Council members and senior managers to highlight and promote the value of the evaluation function.

Snapshot

Evaluation policy

• The Charter for the Evaluation and Internal Audit Office was approved in 2009 and revised in 2012. It is subject to periodic review by the Evaluation and Audit Advisory Committee. The ICAO Evaluation Policy, approved by the ICAO Council in 2014, complements the Charter, and further defines the aims, principles, and planning process of the evaluation function, as well as its role in decentralized evaluations and quality assurance.

Priorities:

• Implementation of the ICAO Evaluation Policy

• Development and monitoring of key performance indicators for the evaluation function

• Preparation of an Evaluation Manual

• Provision of quality assurance and support to decentralized evaluations, within the limits of EAO capacity

Human Resources (for 2015)

• Director: 1 (M)

• Evaluation Officer: 1 (F)

• Support staff (Evaluation and Audit Associate): 1 (M)

• Decentralized evaluation staff : None

Evaluations produced per year (2014) by central unit and by decentralized units

• 3 evaluations produced by central unit, of which :

  • 2 thematic evaluations

  • 1 project evaluation

Key resources:

• ICAO Website (www.icao.int)
• Charter for the Evaluation and Internal Audit Office
• ICAO Evaluation Policy

Independence

The evaluation function of ICAO is co-located with the audit function under the Office of Internal Oversight (OIO). OIO’s work program is approved by the ICAO Council (functional reporting) while C/OIO administratively reports to the Secretary General and functionally to the ICAO Governing Body (the Council). C/OIO has the authority to initiate, carry out and report on any action, which he/she considers necessary to fulfil his/her mandate. C/OIO is free from managerial interference in determining its annual work plan; in establishing the scope of internal audits, evaluations, and other reviews; in the performance of its work; and in reporting the results of its work. S/he has unrestricted access to the President of the Council, the Council, and the EAAC through both formal and informal lines of communication. 

Agenda Setting & Evaluation Planning

The triennium and annual evaluation plan of the evaluation function is prepared by OIO and approved by the ICAO Council. OIO prepares an annual evaluation work plan on the basis of an assessment of risk, evaluability and strategic importance and consultations with Senior Management the EAAC and the ICAO Council. C/OIO is free from managerial interference in determining its annual work plan and in establishing the scope of evaluations. 

Quality Assurance

OIO adheres to the UNEG Norms and Standards for Evaluation in the UN System. When required, OIO establishes s an evaluation advisory committee both from internal and external experts The ICAO Evaluation Policy provides the evaluation function with a mandate for providing quality assurance services to decentralized evaluations, within the limits of its capacity.

Use of Evaluation

Evaluation reports are presented to ICAO Council. C/OIO presents an Annual Report to the Council on the performance of the Office and implementation of the Oversight Plan. This includes, among others, information on all evaluation activities. OIO uses a recommendation tracking system (Symbiant) for monitoring the implementation of recommendations.

Since January 2022 all evaluation reports are published in the ICAO public website.

Joint Evaluation

OIO has not been involved in joint evaluations so far but will participate as necessary.