1. What is evaluation?
2. What is the difference between evaluation and research?
3. What is the difference between evaluation and review?
4. What is meant by monitoring?
5. What is the DAG?
6. What is the UNDAF 2007-2011?

1.     What is evaluation?

The Organisation for Economic Co-operation and Development (OECD), through its Development Assistance Committee (DAC), has recommended the following definition to its member countries: “An evaluation is an assessment, as systematic and objective as possible, of on-going or completed aid activities, their design, implementation and results. The aim is to determine the relevance and fulfilment of objectives, developmental efficiency, effectiveness, impact and sustainability.” [Evaluation Guidelines.  Ministry of Foreign Affairs: Danida. Feb. 1999]

Evaluation is an independent examination of a programme or component. It partly aims to determine its results, efficiency, effectiveness, impact, relevance, and sustainability, and partly to draw lessons that may be more widely applicable. [Evaluation Guidelines. Ministry of Foreign Affairs: Danida. Feb. 1999]

à Principles of Project Evaluation

Project evaluation is a demanding task technically, professionally and politically. Based on its experience, PEMA has identified a set of principles constituting a de facto code of professional behaviour to guide its staff in the process of evaluating foreign aid projects.

The principles listed below are drawn from a variety of sources, especially those of international organisations heavily involved in providing foreign aid and evaluating the impact of foreign aid projects (particular reference is made to the work of the World Bank, UNDP and Development Assistance Committee of the OECD):

§  Careful application of internationally-accepted methodologies and procedures throughout the evaluation process;

§  Objectivity in analysing information and assessing results;

§  Consistency in approach and in conclusions drawn ;

§  Adoption of a holistic approach (versus partial evaluation) to avoid lopsided conclusions;

§  Emphasis on impact evaluation – going beyond financial and individual task-based evaluations;

§  Focus on sustainability prospects and capacity building;

§  Participation of beneficiaries as partners in the evaluation process;

§  Transparency in explaining approach and sharing results with various parties;

§  Respect for confidentiality whenever requested, provided it does not constrain evaluation work or bias its outcome; and

• Cost-effectiveness of evaluation, without undermining quality;

àProject Cycle

To view project evaluation in its proper context, the following diagram depicts the full project cycle. Each component or stage of the cycle has its own requirements if the project is to be well planned, implemented, and evaluated.

2. What is the difference between evaluation and research?

Evaluation differs from research in its purpose, its concern with generalisability, its involvement of stakeholders, and the required breadth of training of those undertaking it. For instance, whereas research seeks to contribute to knowledge in a field, evaluation results may lead to knowledge development, which helps the various stakeholders concerned make informed decisions. In other words, “research seeks conclusions; evaluation leads to judgments.” As for the generalisability of results, evaluation is usually specific to the object that is being evaluated, while research’s findings can be generalised to other settings. The preparation of researchers and evaluators also differs. Researchers are trained “in-depth” in a certain discipline, since in most cases, researchers’ work will be within that single field. On the other hand, evaluators’ training is interdisciplinary since they have to deal with different stakeholders and settings, and have to be knowledgeable about the various evaluation methods and techniques. [Program Evaluation: Alternative Approaches and Practical Guidelines. Third Edition. Fitzpatrick, Jody L., James R. Sanders et al.]

3.   What is the difference between an evaluation and a review?

Review is “an assessment of the performance of a project or programme, periodically or on an as-needed basis.” It is “more extensive than monitoring, but less so than evaluation.” [A Guide for Project M&E. International Fund for Agricultural Development  (IFAD)]

4. What is meant by monitoring?

It is the “regular collection and analysis of information to assist timely decision-making, ensure accountability and provide the basis for evaluation and learning. It is a continuing function that uses methodical collection of data to provide management and the main stakeholders of an ongoing project or programme with early indications of progress and achievement of objectives.” [Managing for Impact in Rural Development: A Guide for Project M&E. IFAD]

5. What is the DAG?

The Donor Assistance Group (DAG) was created in 2001 as an initiative of the UN Resident Coordinator. It constitutes an informal network of bilateral and multilateral donor agencies, providing a forum for policy dialogue and facilitating the coordination of policy and programme activities among donors.

The DAG is composed of a plenary forum and eight thematic sub-groups (Health and Population, Gender and Development, Natural Renewable Resources, Governance, Environment and Energy, Micro, Small and Medium Enterprises, Poverty and Information and Communication Technology). One of the current main functions of the DAG is to extend support to the Government of Egypt according to the Paris Declaration on Aid Harmonisation and Effectiveness.

The chairmanship of the DAG is rotated. The current chair is Mr. Frans van Rijn, Head of Economic Affairs and Development Co-operation, Embassy of the Netherlands.

6. What is the UNDAF 2007-2011?

“The United Nations Development Assistance Framework (UNDAF) 2007-2011 represents the planning structure for operations of the United Nations system in its support of Egypt’s national development priorities over the next five years. The UNDAF, representing both a process and a product, enables a holistic, nationally-owned United Nations approach to country challenges, thus increasing the effectiveness and efficiency of United Nations operations by promoting greater synergy in action.”

“The cornerstone of the UNDAF, 2007-2011, for Egypt is an analysis of human and state capabilities viewed through the aim and obligation of the Government to fulfill the social, economic and political entitlements of its citizens. The analysis shows that the fruitful union between people and the state will come through participative democracy, the social contract between state and society, and the rule of law.”

Source: United Nations Development Assistance Framework: Moving in the Spirit of the Millennium Declaration, the DNA of Progress. United Nations. Egypt. 2006.

7. What is the Paris Declaration on Aid Harmonisation and Effectiveness?

The Paris Declaration, endorsed on 2 March 2005, is an international agreement to which over one hundred Ministers, Heads of Agencies and other Senior Officials adhered and committed their countries and organisations to continue to increase efforts in ownership, alignment, harmonisation, managing aid for results and mutual accountability, with twelve monitorable indicators.

The twelve indicators are:

• Partners have operational development strategies
• Reliable country systems
• Aid flows are aligned with national priorities
• Strengthen capacity by coordinated support
• Use of country public financial management and procurement systems
• Strengthen capacity by avoiding parallel implementation structures
• Aid is more predictable
• Aid is untied
• Use of common agreements or procedures
• Encourage shared analysis
• Results-oriented frameworks
• Mutual accountability