News
Evaluation reports
Integrating a youth perspective
The DIO’s evaluation report recognises efforts to integrate youth perspectives in our work.
The DIO’s evaluation report recognises efforts to integrate youth perspectives in our work.
Key findings
- There is a long-standing tradition of youth participation and engagement, including models that are recognised as exemplars outside the Organisation.
- Youth perspectives tangibly impact the quality and consistency of Council of Europe work.
- A more strategic approach is required to maintain strong initiatives in some entities whilst encouraging more initiatives in others.
- Roles and responsibilities to integrate a youth perspective need to be clearer and assigned more widely.
- Feedback needs to be systematic to build stronger relationships with youth involved in the Organisation.
- Care needs to be taken to ensure youth perspectives align with gender mainstreaming and a human rights-based approach.
- The evaluation encourages major administrative entities to plan for coherent action and provide more mutual support to further integrate a youth perspective across the Organisation.
The Evaluation Division would like to express its gratitude to all stakeholders involved in the exercise.
Related links
Change Management in the Administrative Reform
Is the Organisation equipped to manage reform? A DIO evaluation highlights essential steps forward
The Evaluation Division of the Directorate of Internal Oversight (DIO) has completed an evaluation of Change Management in the Administrative Reform of the Council of Europe.
The evaluation found that the Organisation has been in a continuous state of reform and demonstrated adaptability in response to external challenges like the COVID-19 pandemic and the war of aggression of the Russian Federation against Ukraine. At the same time, the reform process has been primarily reactive and resource-constrained.
Key Findings
- A strategic decision-making mechanism, clear roadmap, and dedicated resources are essential for effective change management,
- Establishing a centralised change management hub and practical guidelines would support a culture of proactive reform,
- Effective communication and staff engagement are critical for successful reform implementation.
The evaluation emphasizes that the Council of Europe faces a critical decision: to invest in the necessary resources, structures, and processes for robust change management, or to adjust reform expectations to align with current resource levels.
All recommendations have been accepted and a management response and action plan has been delivered.
The Evaluation Division of the DIO would like to express its gratitude to all stakeholders involved in the exercise.
Related links
Commissioner for Human Rights
The institution has been evaluated, highlighting successes and opportunities for greater impact
The evaluation of the institution of the Commissioner for Human Rights, carried out by the Evaluation division of the DIO, assessed the institution's contributions from 2017 to 2023, covering the mandates of the third and fourth Commissioners. This review focused on the Commissioner’s role in advocating for human rights, supporting reforms, and providing guidance to member states.
Key Findings
- Credibility and influence: the Commissioner has developed a strong reputation as a credible and influential voice on human rights, particularly through country visits and third-party interventions at the European Court of Human Rights.
- Enhanced rapid response: the Commissioner’s recent shift toward rapid response visits and increased communication with the Committee of Ministers has strengthened the Office’s impact, especially during crises.
- Awareness-raising: success has been noted in raising awareness on human rights issues, especially among civil society groups.
- Opportunity for increased impact: despite these achievements, evidence of legislative and institutional changes remain limited. The evaluation recommends that future Commissioners focus on systematic tracking of the implementation of recommendations and consider reassessing high-level objectives for increased effectiveness.
This evaluation calls attention to the Commissioner’s essential role in promoting Council of Europe human rights standards and highlights opportunities for strengthening future impact.
All recommendations have been accepted and a Management response and action plan has been delivered.
The Evaluation Division of the DIO would like to express its gratitude to all stakeholders involved in this exercise.
Related
Steering Committee on Anti-discrimination, Diversity and Inclusion
Evaluation establishes CDADI’s added value
The Evaluation of the Steering Committee on Anti-discrimination, Diversity and Inclusion (CDADI) was appreciated by CDADI. Management has accepted all five recommendations and designed a response to improve priority areas.
Key findings
CDADI’s umbrella approach is positive and valuable for transversal aspects of Anti-discrimination, Diversity and Inclusion (ADI).
Teams and working groups composed of different services link well with the strategic triangle.
Intersectionality mutually reinforces a human rights-based approach.
More effort needs to be invested in defining strategic goals for the Committee.
Related Links
Apply now to join our pool of evaluation experts
Submit your tenders by 27 June 2024 16:00 CET
The DIO Evaluation Division is seeking highly qualified evaluation companies and experts to join our pool of consultants. If you have the expertise to conduct or contribute to evaluations of our work, we want to hear from you!
We have launched two exciting calls for tenders for consultancy services in the field of evaluation:
- Call for tenders 2024/AO/33 for concluding a Framework Contract for the provision of evaluation related services divided in two lots: Lot 1: evaluation specialists and Lot 2: quality assurance
- Call for tenders 2024/AO/34 for concluding a Framework Agreement for the provision of consultancy services for externally commissioned evaluations
Detailed information on the purpose and scope of each call can be found in the information note.
Don't miss this opportunity to collaborate with the Council of Europe! Submit your tenders by 27 June 2024 16:00 CET.
For any questions, please contact the Evaluation division.
Related links
Civil society participation
The report on the evaluation of the civil society participation in co-operation activities is now available on the webpage of the Directorate of Internal Oversight (DIO). The evaluation complements the previous evaluations, “Evaluation of the contribution of NGOs to standard setting and monitoring in the Council of Europe” and the “Evaluation of the Council of Europe’s Conference of International Non-Governmental Organisations”.
Civil society participation in co-operation activities could contribute, in the words of the Reykjavik Declaration “to further strengthening the work of the Organisation in the field” and to “further reinforcement of the Organisation’s outreach to, and meaningful engagement with, civil society organisations.” The purpose of the evaluation was to assess the current practice of civil society participation in co-operation activities, including the extent to which the human rights approach is applied.
Key findings of the evaluation are:
- The Council of Europe performs well in terms how it uses civil society participation in co-operation activities.
- Civil society organizations have additional unrealistic expectations from the Council of Europe that might need more systematic communication to address.
While deeper involvement of civil society in co-operation activities has the potential to further enhance results, there are limits in terms of resources available to manage such involvement. A more systematic approach to civil society involvement could pave the way to more impactful co-operation activities.
Recommendations suggest ways how to involve civil society more closely in co-operation activities of the Council of Europe.
The DIO would like to express its gratitude to all stakeholders involved in the exercise.
Related links
Independence and Efficiency of Justice sub-programme and Action against crime and protection of citizens
The Evaluation of the Independence and Efficiency of Justice sub-programme and the Evaluation of the work under the sub-programme “Action against crime and protection of citizens” – cybercrime and trafficking in human beings
The two abridged reports as well as their management responses and action plans are now available:
The evaluation provides a number of recommendations concerning the sub-programme’s structure, co-ordination, design and monitoring in order to improve and increase effectiveness and impact of the sub-programme including the allocation of additional resources to the CCJE and CCPE.
The evaluation provides a number of recommendations aiming to redefine the sub-programme’s Theory of Change, indicators and targets, develop a strategy of alliances to support legislative change, set up a forum for dialogue with civil society, put in place staff consultation mechanisms and processes, share lessons from implementation, revise the co-operation strategy in trafficking in human beings and analyse the feasibility of the present assessment model in cybercrime.
The full evaluation reports will be available in the coming weeks.
The Evaluation Division of the DIO would like to express its gratitude to all stakeholders involved in the exercise.
Related links for the evaluation of the Independence and Efficiency of Justice sub-programme:
- Evaluation report - abridged version
- Management response and action plan
- Infographic (facts and figures)
Related links for the evaluation of the work under the sub-programme “Action against crime and protection of citizens” – cybercrime and trafficking in human beings:
- Evaluation report - abridged version
- Management response and action plan
- Infographic (facts and figures)
Peer Review of the Evaluation Function
The Evaluation Policy approved by the Committee of Ministers in 2019, foresaw an external peer review in 2022. The Peer Review Report prepared by the independent panel of experts on the evaluation function of the Organisation, as well as the management response and action plan, are now available and published.
Overall, the findings revealed that the evaluation function in the Council of Europe has been noticeably strengthened over the past years. Whilst the organisational evaluation culture has improved, the review found that it was still not mature. Recommendations were made to:
- Optimise the selection of evaluation subjects by inviting the Secretary General, Committee of Ministerand senior management to propose evaluation topics;
- Assure coverage of the evaluation universe, including the Parliamentary Assembly of the Council of Europe, the European Court of Human Rights standard setting and monitoring mechanisms;
- Enhance resources for evaluation by earmarking a percentage of the total budget of the Council of Europe;
- Strengthen the usefulness of evaluation reports through better stakeholder engagement and learning products;
- Strengthen the visibility and authority of the Evaluation Division;
- Invest more in decentralised evaluations by increasing their coverage, resources and capacities; establishing a simple criterion for mandatory evaluations, strengthening their independence, establishing focal points and publishing final evaluation reports.
The independent peer review panel was made up of:
- Mr. Arild Hauge, Chair of the Peer Review Panel, former Deputy Director of the lndependent Evaluation Office of UNDP, Oslo
- Ms. Claudia lbarguen, Peer Review Panel Member, Head of Evaluation at UNESCO, Paris
- Mr. Guy Thijs, Peer Review Panel Member, Director, Office of Evaluation, ILO, Geneva
- Mr. Urs Zollinger, Peer Review Consultant, Evaluator, Zurich
Related links
Covid-19 pandemic
The report on the Evaluation of the support to member states in addressing challenges related to the Covid-19 pandemic, as well as the management response and action plan are now available on the webpage of the Directorate of Internal Oversight (DIO).
The purpose of the evaluation was to assess the extent to which the Council of Europe’s programmatic response to the crisis through its support to member states assisted them in fulfilling their commitments to maintaining human rights, rule of law and democracy in the context of threats and challenges posed by the pandemic.
Overall, the findings reveal that the Council of Europe was able to respond despite little preparedness for a crisis of such magnitude.
The evaluation provides a number of recommendations to further strengthen institutional capacity to manage crisis, to optimise the Organisation’s crisis preparedness and to reinforce the strong resilience the Organisation demonstrated during the pandemic.
The Evaluation Division of the DIO would like to express its gratitude to all stakeholders involved in the exercise.
Related links
Monitoring mechanisms
The evaluation report on the Council of Europe’s monitoring mechanism as well as the Management response and Action plan are now available on the webpage of the Directorate of Internal Oversight (DIO).
The purpose of the evaluation was to assess the Council of Europe’s monitoring mechanisms with a view to identify lessons from past experiences and good practices and to make recommendations on how their relevance, effectiveness, efficiency and added value can be improved. The evaluation also looked at possibilities of developing synergies and benchmarked against mechanisms in other organisations.
The evaluation found that while monitoring mechanisms are very relevant, generally effective, efficient and high in added value, some aspects could be improved to further increase their effectiveness and efficiency.
The report recommends to:
- further strengthen follow-up given to recommendations of monitoring mechanisms and direct dialogue with member states,
- ensure there is a forum for discussing good practices and working methods,
- explore further increasing the co-operation and co-ordination, including the links between the monitoring and co-operation dimensions,
- enhance gender mainstreaming and consideration of equity,
- increase the accessibility and the visibility of monitoring mechanisms’ products and ensuring that necessary resources are provided to them.
The Evaluation Division of the DIO would like to express its gratitude to all stakeholders involved in the exercise.
Related links
Violence against women and domestic violence
The report on the Evaluation of the Council of Europe’s work under the sub-programme Violence against women and domestic violence (VAWDV) (2016 to 2020), as well as the management response and action plan are now available on the webpage of the Directorate of Internal Oversight (DIO).
The objectives of the evaluation were to draw lessons on how the Council of Europe’s standard setting, monitoring, cooperation and partnerships have contributed to changes towards the elimination of VAWDV, and to inform the Organisation in its future decision making.
The evaluation finds that the holistic approach of the Istanbul Convention to VAWDV requires continuous learning and coordination, both within the Council of Europe and in the countries which implement it. This continuous learning process is long and demanding, but there is gradual progress linked to the Convention, its monitoring, and related cooperation programmes.
The evaluation report makes a number of recommendations. In order to further optimise its work, the sub-programme needs to sharpen its focus, building on the Council of Europe’s legal innovation trademark, to expand its synergies with other international organisations and international civil society organisations, and rally further supporters.
The Evaluation Division of the DIO would like to express its gratitude to all stakeholders involved in the exercise.
Related links
Venice Commission
The report on the Evaluation of the European Commission for Democracy through Law (Venice Commission) has been published
The report on the Evaluation of the European Commission for Democracy through Law (Venice Commission), as well as the management response and action plan are now available on the webpage of the Directorate of Internal Oversight (DIO).
The aims of the evaluation were to assess the Venice Commission’s relevance, effectiveness and efficiency for the period 2016-2020 and evaluate its impact since its establishment in 1990. The report’s findings contribute to decision-making needs and provide recommendations to support learning opportunities, innovation and change for the Venice Commission.
The evaluation found that the Venice Commission is a highly relevant body of the Council of Europe, but that it requires additional resources to maintain its high standards and quality of work. Recommendations address strategic as well as operational issues, such as clarifying the rules of procedure and internal working processes; revising the process for the appointment of members; strengthening internal and external communication efforts; increasing the dialogue-based approach with member states as well as developing an internal monitoring and evaluation framework to measure impact of its work.
The Evaluation Division of the DIO would like to express its gratitude to all stakeholders involved in the exercise.
Related links
Pool of Evaluation consultants
An organisation-wide pool of evaluation consultants has been established through a Framework Contract valid until 30 June 2026 (Contract No. 2021/FC/01).
The pool of evaluators, established by the Directorate of Internal Oversight is part of the decentralised evaluations quality assurance framework, enabling all entities to select evaluation consultants with strong qualifications and experience, as well as thematic and geographic expertise.
The Framework contract aims to support the implementation of evaluations/evaluation-related assignments and is divided into the following:
- Lot 1: implementation of or contribution to an evaluation,
- Lot 2: provision of evaluation-related consultancy services (e.g. Monitoring and Evaluation (M&E) advice, theories of change, evaluation quality assurance, trainings, etc).
Evaluation consultants from the pool can be called upon by simply submitting an order form to the selected Service Provider(s).
As part of the framework, entities are requested to provide to the DIO the Terms of Reference for the planned tasks stating the required consultant expertise. The DIO will review the ToR and propose suitable consultants including their CVs.
Detailed instructions on the steps that MAEs are to follow when calling upon an evaluation consultant can be found in the following information note.
Related links
Conference of INGOs
The report on the evaluation of the Council of Europe’s Conference of International Non-Governmental Organisations (INGOs) as well as the management response and action plan are now available on the DIO webpage.
The evaluation aimed to assess the relevance, effectiveness and added value of the Conference’s support to INGOs within the Council of Europe.
The evaluation findings show that the Conference is a unique civil society consultation mechanism whose institutional role remains insufficiently defined. The report underlines that it is crucial for the Conference to maintain and enhance the quality of its activities, the level of commitment and the diversity of its membership, while deepening the Conference's synergies with other relevant actors. The Council of Europe should ensure an adequate level of support to the Conference to achieve these objectives.
The evaluation makes a number of recommendations:
- At strategic level, recommendations concern the definition of the mission statement, alignment of the Conference’s priorities and objectives with the Council of Europe’s Programme and Budget and resources required to achieve these objectives.
- At operational level, recommendations concern the strengthening of co-operation during and between sessions, reassessment of eligibility criteria, cooperation with national NGOs, development of a communication strategy, and more active cooperation with PACE.
A management response and action plan in respect of the recommendations has been prepared by the Secretariat and is available on the DIO website together with the report.
The Evaluation Division of the DIO would like to express its gratitude to all stakeholders involved in the exercise.
Related links
Prisons and police
The report on the evaluation of the Council of Europe’s Conference of International Non-Governmental Organisations (INGOs) as well as the management response and action plan are now available on the DIO webpage.
The evaluation aimed to assess the relevance, effectiveness and added value of the Conference’s support to INGOs within the Council of Europe.
The evaluation findings show that the Conference is a unique civil society consultation mechanism whose institutional role remains insufficiently defined. The report underlines that it is crucial for the Conference to maintain and enhance the quality of its activities, the level of commitment and the diversity of its membership, while deepening the Conference's synergies with other relevant actors. The Council of Europe should ensure an adequate level of support to the Conference to achieve these objectives.
The evaluation makes a number of recommendations:
- At strategic level, recommendations concern the definition of the mission statement, alignment of the Conference’s priorities and objectives with the Council of Europe’s Programme and Budget and resources required to achieve these objectives.
- At operational level, recommendations concern the strengthening of co-operation during and between sessions, reassessment of eligibility criteria, cooperation with national NGOs, development of a communication strategy, and more active cooperation with PACE.
A management response and action plan in respect of the recommendations has been prepared by the Secretariat and is available on the DIO website together with the report.
The Evaluation Division of the DIO would like to express its gratitude to all stakeholders involved in the exercise.
Related links:
Results-based management
The report on the evaluation of Results-based management in the Council of Europe as well as the management response and action plan are now available.
The evaluation assesses whether the current RBM system provides pertinent information for both policy and performance management and if this information is used for decision making.
In respect of the four major purposes generally associated with RBM:
- Accountability,
- Communication,
- Decision making,
- Learning.
The evaluation finds that the Organisation currently has most of the elements required to support good accountability and communication and recommends that a strategic choice is made on how to meet all four purposes in future.
The evaluation makes a number of recommendations for improving the current system. The recommendations have been situated at two levels: 1. the strategic choice that the Organisation needs to make on the level of ambition for, and the purpose of RBM; and 2. improvements that can be made irrespective of the strategic choice made.
All recommendations have been accepted by management and a management response and action plan in respect of the recommendations has been prepared by the Secretariat. This is available on the DIO website together with the report.
The Evaluation Division of the DIO would like to express its gratitude to all stakeholders involved in the exercise.
Related links:
Strategy Development and Reporting
The report on the evaluation of the Strategy Development and Reporting in the Council of Europe as well as the management response and action plan have been published.
The evaluation assesses the processes of preparation and formulation of and reporting on Council of Europe strategies, including the factors that influence the quality of their development and uptake. The report also correlates the impact of these strategic planning processes with enhanced organisational performance.
As such, the evaluation identifies several lessons learnt and makes a number of recommendations for improving the preparation of future strategies in general and for the Secretary General’s strategic outlook that is being developed, in particular.
All recommendations have been accepted by management and a management response and action plan in respect of the recommendations has been prepared by the Secretariat. This is available on the DIO website together with the report.
The Evaluation Division of the DIO would like to express its gratitude to all stakeholders involved in the exercise.
Related links :
Discussion on the Evaluation of Intergovernmental Committees, 10 October 2019
The Directorate of Internal Oversight cordially invites members of the Permanent Representations and staff to a presentation and discussion of the results of the Evaluation of Intergovernmental Committees report on Thursday 10 October 2019 from 10 am to 12.30 pm in Room 1 of the Palais. The presentation will be made by the evaluation team from the "Centre for Strategy and Evaluation Services".
Following the presentation, participants will have an opportunity to ask questions and discuss the evaluation report, including the proposed follow-up.
Related links
Intergovernmental committees
The report on the evaluation of the intergovernmental committees and management response are now available.
The Council of Europe’s intergovernmental committee system lies at the heart of the organisation and has a critical role to play in helping to deliver its mandate. Do the committees address the needs of member states and are they relevant to the objectives of the organisation? Do they achieve their objectives? Are they efficient?
The evaluation found that the intergovernmental committees have achieved a great deal over the years and play an essential role in developing common standards in the field of human rights, democracy and the rule of law across the Council of Europe’s 47 member states. These common standards are also used as reference by the European Court of Human Rights and the monitoring mechanisms. In wide-ranging policy areas the committees are an essential link between the Council of Europe and its member states and in some cases, like the Cultural Convention, also with non-member states. Overall, they play a key role in achieving greater unity between member states, which is an aim set out in the Statute of the Organisation. The activities of the committees are generally very relevant both in addressing the needs of the member states and the objectives of the Council of Europe. The evaluation found however that in recent years the intergovernmental committee system has faced increasing financial constraints that have made the fulfilment of some tasks more difficult. Findings also revealed that there is a need for improved coherence, more flexible deployment of resources, greater accessibility to real-time information and a more focused sense of strategic orientation.
The evaluation identifies three possible scenarios for the future and makes a number of recommendations in respect of the committee system, including:
- The establishment of strategic frameworks for the committees and reporting at strategic level;
- Clarification on how committees are established and dissolved;
- Reinforced coordination and cooperation between the committees;
- Mobilisation of extra-budgetary resources to support the work of the committees;
- Increased flexibility in the planning and deployment of human and financial resources available to committees;
- Improved communication of activities of committees, including a single gateway;
- Increased evaluation of the performance of individual committees; and
- Changes to Resolution CM/Res(2011)24 to put into effect the accepted recommendations.
A management response in respect of the recommendations has been prepared by the Secretariat and is available on the DIO website together with the report.
The Evaluation Division would like to express its gratitude to the members of intergovernmental committees, Permanent Representations and the Council of Europe staff involved in the exercise.
Related links
Freedom of expression
The report on the evaluation of the support to the protection and promotion of freedom of expression is now available.
The evaluation found that the CoE’s work on freedom of expression is addressing partner needs and effectively encourages compliance with CoE standards, most notably via the Platform for the Protection of Journalism and via cooperation activities. The evaluation also suggests that the CoE conducts its work with a view to sustainability by systematically involving civil society organisations as multipliers, and in the design of cooperation activities.
The evaluation makes a number of recommendations, including:
- developing a strategic framework on freedom of expression that involves all relevant actors in the CoE;
- enhancing leadership and coordination, for example by creating the function of a "Special Representative" or "Special Adviser" of the Secretary General on freedom of expression;
- further promoting the visibility of the Platform;
- prioritising capacity development for civil society organisations and ombudsperson offices as prominent defenders of standards;
- strengthening Field Office human resources in selected thematic areas of freedom of expression, and
- further facilitating access to CoE outputs on freedom of expression beyond the framework of cooperation activities.
The Evaluation Division of the DIO would like to express its gratitude to the partners in member States and the Council of Europe staff involved in the exercise.
Related links
Support in the fight against corruption
The report on the evaluation of the Council of Europe’s support in the fight against corruption is now available on the DIO webpage.
The evaluation finds that the Council of Europe’s support to states in the fight against corruption is highly relevant for member States as well as non-member States and addresses high level corruption in particular sectors of key concern. The Council of Europe is valued as a trustworthy and unbiased international player that offers good quality expertise and provides the unique added value of its dynamic triangle of well-established anti-corruption standards, country monitoring and technical co-operation.
The evaluation recommends that the Organisation further improves its visibility and leverage, internal and external cooperation and coordination as well as its working methods related to GRECO monitoring procedures, project management and follow-up activities of the opinions of the Venice Commission.
The Evaluation Division of the DIO would like to express its gratitude to the partners in member States and the Council of Europe staff involved in the exercise.
Related links:
Resource mobilisation and allocation
Voluntary contributions to support the Council of Europe’s work have considerably increased in the past few years. These contributions provide significant support to cooperation activities. The evaluation report on resource mobilisation and allocation noted the progress made and provides input to inform future review of policies and practices in this field.
The following key aspects were highlighted:
- Through the combined effect of donor trust, and resource mobilisation efforts and tools, extra-budgetary contributions have considerably increased and fuelled the emergence of strong thematic sectors capable of planning and implementing cooperation activities,
- Voluntary contributions have yet to cover all the financial needs in the area of cooperation. To ensure greater coverage, the report suggests the exploration of so far untapped sources within the different entities in the European Union,
- The internal processes governing resource mobilisation prioritisation and predictability could be improved and rendered more transparent,
- Whilst the Council of Europe has invested considerably to develop its cooperation capacity and to raise extra-budgetary resources, some internal administrative and structural constraints need be addressed, and communication between the relevant internal actors should be strengthened.
The Evaluation Division of the DIO would like to express its gratitude to the Council of Europe staff and donors interviewed as well as to the staff members of other international organisations who were interviewed or provided documentation during this evaluation.
Furthermore, please note that the Evaluation report of Digital communications and access to information is also available.
Related links
Invitation to a High-level event on Evaluation Culture and Policy
On behalf of the Deputy Secretary General, Gabriella Battaini-Dragoni, the Evaluation Division of the DIO cordially invites you to a High-level Event which will take place on Friday 9 November 2018 from 10 am to 1 pm, in Room 1 of the Palais.
High-level guest speakers from UNESCO, OECD, the European Commission and the Oversight Advisory Committee, will be present to share their experiences on standards and practices with regard to evaluation functions in international organisations.
Related links:
