The World Bank Implementation Status & Results Report Skills Development & Innovation Support (P128378) Skills Development & Innovation Support (P128378) EUROPE AND CENTRAL ASIA | North Macedonia | Education Global Practice | IBRD/IDA | Investment Project Financing | FY 2014 | Seq No: 12 | ARCHIVED on 20-Dec-2019 | ISR39927 | Implementing Agencies: Ministry of Finance, Ministry of Education and Science Key Dates Key Project Dates Bank Approval Date: 28-Jan-2014 Effectiveness Date: 11-Mar-2014 Planned Mid Term Review Date: 25-Sep-2017 Actual Mid-Term Review Date: 25-Sep-2017 Original Closing Date: 31-May-2019 Revised Closing Date: 30-Jun-2020 pdoTable Project Development Objectives Project Development Objective (from Project Appraisal Document) The Project Development Objective (PDO) is to improve transparency of resource allocation and promote accountability in higher education, enhance the relevance of secondary technical vocational education, and support innovation capacity in Macedonia. Has the Project Development Objective been changed since Board Approval of the Project Objective? No Components Table Name Improving Transparency of Higher Education:(Cost $4.00 M) Modernization of Secondary Technical Vocational Education and Training:(Cost $4.50 M) Improving the innovative capacity of enterprises and collaboration with research organizations:(Cost $12.94 M) Project Management and Monitoring and Evaluation:(Cost $2.50 M) Overall Ratings Name Previous Rating Current Rating Progress towards achievement of PDO Moderately Satisfactory Moderately Unsatisfactory Overall Implementation Progress (IP) Moderately Satisfactory Moderately Unsatisfactory Overall Risk Rating Substantial Substantial Implementation Status and Key Decisions A moderate implementation progress was recorded since the last review in May 2019. The preparatory work related to secondary Technical Vocational Education and Training (TVET) reform was completed and the new curriculum was rolled out in all secondary TVET schools in North Macedonia. The Fund for Innovation and Technological Development (FITD) completed its last call for the instrument “commercialization of innovation” to be financed from the loan proceeds. As of the next fiscal year, the government will finance the calls for the innovation instruments by the state budget. However, very limited progress was made in the implementation of Higher Education (HE) activities. Two bodies, key for improving 12/20/2019 Page 1 of 11 The World Bank Implementation Status & Results Report Skills Development & Innovation Support (P128378) the quality assurance of the HE sector have not been established yet. Therefore, the overall implementation progress is rated moderately unsatisfactory to account for the very limited progress in the implementation of the HE component. 12/20/2019 Page 2 of 11 The World Bank Implementation Status & Results Report Skills Development & Innovation Support (P128378) 12/20/2019 Page 3 of 11 The World Bank Implementation Status & Results Report Skills Development & Innovation Support (P128378) Risks Systematic Operations Risk-rating Tool Risk Category Rating at Approval Previous Rating Current Rating Political and Governance -- Substantial Substantial Macroeconomic -- Substantial Substantial Sector Strategies and Policies -- Moderate Moderate Technical Design of Project or Program -- Moderate Moderate Institutional Capacity for Implementation and Sustainability -- Moderate Moderate Fiduciary -- Low Low Environment and Social -- Low Low Stakeholders -- Moderate Moderate Other -- -- -- Overall -- Substantial Substantial Results PDO Indicators by Objectives / Outcomes 12/20/2019 Page 4 of 11 The World Bank Implementation Status & Results Report Skills Development & Innovation Support (P128378) Improving Transparency of Higher Education IN00783476 ►% of public universities receiving financing based on new, transparent funding model. (Percentage, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 0.00 80.00 Date 28-Mar-2014 23-May-2019 11-Dec-2019 30-Jun-2020 The new Law on HE inter alia stipulates establishment of a National Council as a new independent body of experts, responsible for higher education and science and research. The National Council will have a mandate to propose a National Program for Higher Education and a Rulebook on the Measures and Criteria for the Financing of the HE. It was expected that this body would be constituted by end -June Comments: 2019 and would adopt the bylaw on financing soon after its formation.The reports to underpin the by-law have been prepared. However, the formation of the Council is delayed. The Minister confirmed that it will be formed by the end of February 2020. IN00783479 ►% of study programs accredited /reaccredited utilizing new quality assurance measures developed in accordance with Bologna-defined norms by the new Quality Assurance Agency (Percentage, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 0.00 80.00 Date 21-Jan-2019 23-May-2019 11-Dec-2019 30-Jun-2020 The new Law on HE inter alia stipulates establishment of an Agency for Quality Assurance, responsible for accreditation and institutional evaluation of the HE Institutions. This institution will be responsible for re-accreditation of all study programs. There is delays in establishment of the agency. The Director is Comments: about to be nominated by the Parliament and the Minister reassured that the Agency will be established by the end of February 2020. Modernization of Secondary Education Vocational Education and Training IN00783477 ►% of secondary TVET students benefiting from practical training in SME and large-sized firms. (Percentage, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 36.30 37.60 37.80 40.00 Date 18-Apr-2018 23-May-2019 11-Dec-2019 30-Jun-2020 Comments: Improving the Innovative Capacity of Enterprises and Collaboration with Research Organization IN00783478 ►Share of private funding mobilized as a percentage of FITD investments in innovation activities. (Percentage, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 73.20 54.88 25.00 12/20/2019 Page 5 of 11 The World Bank Implementation Status & Results Report Skills Development & Innovation Support (P128378) Date 28-Mar-2014 07-Jun-2019 11-Dec-2019 30-Jun-2020 The value of the actual previous is wrong. The accurate value is 38.51%. Comments: IN00783480 ►% of beneficiaries that sign collaborative agreements between firms and academia. (Percentage, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 14.28 7.00 20.00 Date 28-Mar-2014 23-May-2019 11-Dec-2019 30-Jun-2020 The value of this indicator declined because one collaborative agreements was terminated. Comments: Intermediate Results Indicators by Components Improving Transparency of Higher Education IN00783481 ►Implementation of new higher education funding model. (Text, Custom) Baseline Actual (Previous) Actual (Current) End Target The possible funding The possible funding models have been models have been presented to the presented to the government and public government and public universities. universities. In accordance with the In accordance with the The new funding model new law for the Higher new law for the Higher New funding model Value is not developed Education a National Education a National implemented loped Council on Higher Council on Higher Education should be Education will adopt established by end June the bylaws on 2019. This Council will financing. The Council adopt the bylaws on has not been formed financing. yet Date 28-Mar-2014 23-May-2019 11-Dec-2019 30-Jun-2020 The possible funding models have been presented to the government and public universities. In accordance with the new law for the Higher Education , a National Council will adopt the bylaws on Comments: financing. However, the formation of the Council is postponed. IN00783485 ►Number of public universities that have completed an external evaluation utilizing new quality assurance measures developed in accordance with Bologna-defined EU norms and practices. (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 6.00 6.00 5.00 Date 28-Mar-2014 18-Apr-2018 11-Dec-2019 30-Apr-2019 EUA has completed evaluation of all six (6) HEIs, and has delivered 6 individual reports to the HEIs and Comments: one on system wide report to the MoES. IN00783489 ►National TTO established and operational (Text, Custom) 12/20/2019 Page 6 of 11 The World Bank Implementation Status & Results Report Skills Development & Innovation Support (P128378) Baseline Actual (Previous) Actual (Current) End Target Value Not in existence No No TTO operational Date 28-Mar-2014 23-May-2019 11-Dec-2019 30-Jun-2020 The Fund for Innovation and Technological Development is developing a feasibility study for a Science and Technology Park which is envisioned to include the NTTO. The Bank team discussed options for the NTTO as it is envisioned to be implemented under the SDIS project while a Science and Technology Park Comments: will take a longer time to be established. The World Bank team has been working with the FITD on development of a draft outline and timeline for the NTTO establishment. The implementation is delayed. IN00783492 ►Agency for Quality Assurance and Accreditation achieves affiliate membership in ENQA (the European Association for Quality Assurance in Higher Education) (Text, Custom) Baseline Actual (Previous) Actual (Current) End Target The law on Higher Education stipulates establishment of a new Agency for Quality Assurance. The new Agency will have a mandate to start implementing the quality assurance reforms The Agency has not Board of Quality toward stabilizing the been established Agency for Quality Assurance and accreditation system yet.The team believes Assurance achieves Value Accreditation NOT a support improvement of that the likelihood for affiliate member status member of ENQA the internal/institutional achieving this indicator in ENQA quality assurance to be achieved is low mechanisms. The PMU has hired a local expert to support implementing reforms in compliance with the new Law on Higher Education. This activity is on track. Date 28-Mar-2014 07-Jun-2019 11-Dec-2019 30-Jun-2020 The law on Higher Education stipulates establishment of a new Agency for Quality Assurance. The new Agency will have a mandate to start implementing the quality assurance reforms toward stabilizing the accreditation system and the institutional quality assurance mechanisms. The PMU has hired a local Comments: expert to support implementing the reforms in compliance with the new Law on Higher Education. However, the Agency has not been established yet. The team believes that the likelihood to achieve this indicator is low. Modernization of Secondary Technical Vocational Education and Training IN00783482 ►TVET action plan that promotes general and broader technical education and competence- based learning adopted (Text, Custom) Baseline Actual (Previous) Actual (Current) End Target Value Not in existence Model adopted. Model adopted. Model adopted Date 10-Sep-2013 10-Oct-2017 11-Dec-2019 31-Jan-2016 IN00783486 ►% of developed TVET occupational standards by professional fields (Percentage, Custom) 12/20/2019 Page 7 of 11 The World Bank Implementation Status & Results Report Skills Development & Innovation Support (P128378) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 100.00 100.00 100.00 Date 10-Sep-2013 29-Oct-2018 11-Dec-2019 31-Jan-2019 IN00783493 ►% of updated TVET curricula in line with occupational standards (Percentage, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 69.00 100.00 100.00 Date 10-Sep-2013 23-May-2019 11-Dec-2019 30-Sep-2019 All curricula are developed and adopted by the Minister of Education. Comments: IN00783495 ►% Increase in number of companies providing practical training to secondary TVET students. (Percentage, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 21.79 15.80 30.00 Date 15-Jan-2015 23-May-2019 11-Dec-2019 30-Jun-2020 IN00783497 ►Manual and training materials for quality delivery of new curricula adopted (Yes/No, Custom) Baseline Actual (Previous) Actual (Current) End Target Value No Yes Yes Yes Date 10-Sep-2013 10-Oct-2017 11-Dec-2019 31-May-2018 This activity is on track.. Comments: Improving the innovative capacity of enterprises and collaboration with research organizations IN00783484 ►Share of resources dedicated to Fund for Innovation and Technology Development (FITD) instruments disbursed (Percentage, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 23.30 28.60 100.00 Date 10-Sep-2013 23-May-2019 11-Dec-2019 30-Jun-2020 The total amount dedicated to implementation of the innovation instrument will be fully disbursed by the current closing date of the project. Comments: IN00783488 ►Number of companies established via the FITD Accelerator program (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 15.00 15.00 12/20/2019 Page 8 of 11 The World Bank Implementation Status & Results Report Skills Development & Innovation Support (P128378) Date 10-Sep-2013 23-May-2019 11-Dec-2019 30-Jun-2020 IN00783491 ►Number of beneficiary firms to introduce new/improved products (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 84.00 93.00 55.00 Date 10-Sep-2013 23-May-2019 11-Dec-2019 30-Jun-2020 This is on track. Comments: IN00783494 ►% of beneficiaries receiving training and mentoring (Percentage, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 100.00 100.00 70.00 Date 28-Mar-2014 23-May-2019 11-Dec-2019 30-Jun-2020 IN00783496 ►Number of beneficiary firms to introduce new processes (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 3.00 3.00 4.00 Date 10-Sep-2013 23-May-2019 11-Dec-2019 30-Jun-2020 Project Management and Monitoring and Evaluation IN00783483 ►Evaluations for Innovation grants designed, conducted and reports reported (Text, Custom) Baseline Actual (Previous) Actual (Current) End Target Both the baseline and Both the baseline and follow up surveys are follow up surveys are Evaluation reports Value Not in existence ongoing. It is expected ongoing. The baseline completed and results baseline to be finished by is expected to finish by disseminated the end of 2019. the end of 2019. Date 10-Sep-2013 23-May-2019 11-Dec-2019 30-Jun-2020 This activity is on track. Comments: IN00783487 ►Skills Observatory established, providing information about TVET and HE performance to the public (Text, Custom) Baseline Actual (Previous) Actual (Current) End Target The activities for The activities for development of the development of Skills The info on platform Skills Observatory are Value Not in existence Observatory are finished. being updated at least finished. The activities The activities for First twice per year for the first tracer study Macedonian Tracer study are finished. are finished. Date 10-Sep-2013 23-May-2019 11-Dec-2019 30-Jun-2020 12/20/2019 Page 9 of 11 The World Bank Implementation Status & Results Report Skills Development & Innovation Support (P128378) IN00783490 ►Percentage of students that participated in the Grant Program satisfied with their engagement during grant preparation (Percentage, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 83.00 60.00 Date 13-Feb-2019 13-Feb-2019 11-Dec-2019 29-May-2020 The feedback from the students was obtained through the survey, conducted in June 2019. The survey shows that 83% of the students that participated in the Grant Program are satisfied with their engagement during the grant program preparation. This indicator will be monitored again in May 2020 in order to see Comments: whether there is progress in the student’s engagement in the preparation of the new cycle of the grant program, that was launched this school year. Data on Financial Performance Disbursements (by loan) Project Loan/Credit/TF Status Currency Original Revised Cancelled Disbursed Undisbursed % Disbursed P128378 IBRD-83320 Effective USD 24.00 24.00 0.00 11.53 10.46 52% Key Dates (by loan) Project Loan/Credit/TF Status Approval Date Signing Date Effectiveness Date Orig. Closing Date Rev. Closing Date P128378 IBRD-83320 Effective 28-Jan-2014 07-Feb-2014 11-Mar-2014 31-May-2019 30-Jun-2020 Cumulative Disbursements 12/20/2019 Page 10 of 11 The World Bank Implementation Status & Results Report Skills Development & Innovation Support (P128378) Restructuring History Level 2 Approved on 01-Mar-2019 Related Project(s) There are no related projects. 12/20/2019 Page 11 of 11