Public Disclosure Copy The World Bank Implementation Status & Results Report Skills Development & Innovation Support (P128378) Skills Development & Innovation Support (P128378) EUROPE AND CENTRAL ASIA | Macedonia, former Yugoslav Republic of | Education Global Practice | IBRD/IDA | Investment Project Financing | FY 2014 | Seq No: 9 | ARCHIVED on 05-May-2018 | ISR32248 | Implementing Agencies: Ministry of Finance, Ministry of Education and Science Key Dates Key Project Dates Bank Approval Date:28-Jan-2014 Effectiveness Date:11-Mar-2014 Planned Mid Term Review Date:25-Sep-2017 Actual Mid-Term Review Date:25-Sep-2017 Original Closing Date:31-May-2019 Revised Closing Date:31-May-2019 Project Development Objectives Project Development Objective (from Project Appraisal Document) The Project Development Objective (PDO) is to improve transparency of resource allocation and promote accountability in higher education, enhance the relevance of secondary technical vocational education, and support innovation capacity in Macedonia. Has the Project Development Objective been changed since Board Approval of the Project Objective? No PHRPDODEL Components Name Improving Transparency of Higher Education:(Cost $4.00 M) Modernization of Secondary Technical Vocational Education and Training:(Cost $4.50 M) Improving the innovative capacity of enterprises and collaboration with research organizations:(Cost $12.94 M) Project Management and Monitoring and Evaluation:(Cost $2.50 M) Overall Ratings Name Previous Rating Current Rating Progress towards achievement of PDO  Moderately Satisfactory  Moderately Satisfactory Overall Implementation Progress (IP)  Moderately Satisfactory  Moderately Satisfactory Overall Risk Rating  Substantial  Substantial 5/5/2018 Page 1 of 17 Public Disclosure Copy Public Disclosure Copy The World Bank Implementation Status & Results Report Skills Development & Innovation Support (P128378) Implementation Status and Key Decisions The likelihood that the project will achieve its outcomes by the current end-date is moderate. The activities that are behind schedule are mainly related to the Higher Education (HE) component. The implementation of other components related to reforming the TVET system and the Innovation instruments have advanced significantly since the last ISR. While there is some progress in the implementation of activities under the HE component, significant delay remains with regard to introduction of a HE financing model. The current disbursement rate is 28%, while the disbursement initially expected for the current phase of project implementation was 62%. The authorities are confident that in the next several months there will be significant increases in spending of the loan proceeds, which would result from the implementation of the 4th call for two innovation instruments, initiation of the 5th call for these two instruments and for the remaining two innovation instruments, implementation of the TVET grant program and expediting activities in the Higher Education (HE) sector. Given the appropriate funds allocation in the budget for the project and the recently achieved results, accomplishment of the abovementioned outputs and targets is doable. 5/5/2018 Page 2 of 17 Public Disclosure Copy Public Disclosure Copy The World Bank Implementation Status & Results Report Skills Development & Innovation Support (P128378) 5/5/2018 Page 3 of 17 Public Disclosure Copy Public Disclosure Copy The World Bank Implementation Status & Results Report Skills Development & Innovation Support (P128378) 5/5/2018 Page 4 of 17 Public Disclosure Copy Public Disclosure Copy The World Bank Implementation Status & Results Report Skills Development & Innovation Support (P128378) 5/5/2018 Page 5 of 17 Public Disclosure Copy Public Disclosure Copy The World Bank Implementation Status & Results Report Skills Development & Innovation Support (P128378) 5/5/2018 Page 6 of 17 Public Disclosure Copy Public Disclosure Copy The World Bank Implementation Status & Results Report Skills Development & Innovation Support (P128378) 5/5/2018 Page 7 of 17 Public Disclosure Copy Public Disclosure Copy The World Bank Implementation Status & Results Report Skills Development & Innovation Support (P128378) Risks Systematic Operations Risk-rating Tool Risk Category Rating at Approval Previous Rating Current Rating Political and Governance  --  Substantial  Substantial Macroeconomic  --  Substantial  Substantial Sector Strategies and Policies  --  Moderate  Moderate Technical Design of Project or Program  --  Moderate  Moderate Institutional Capacity for Implementation and Sustainability  --  Moderate  Moderate Fiduciary  --  Low  Low Environment and Social  --  Low  Low Stakeholders  --  Moderate  Moderate Other  --  --  -- Overall  --  Substantial  Substantial Results 5/5/2018 Page 8 of 17 Public Disclosure Copy Public Disclosure Copy The World Bank Implementation Status & Results Report Skills Development & Innovation Support (P128378) Project Development Objective Indicators PHINDPDOTBL  % of public universities receiving financing based on new, transparent funding model. (Percentage, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 0.00 80.00 Date 28-Mar-2014 04-Oct-2017 18-Apr-2018 30-Apr-2019 Comments The criteria for allocation of funds to the public universities is determined in the draft law for the Higher Education. The law should be adopted by the Parliament in June, 2018. After adoption of the law, the National Council on Higher Education will develop and adopt a bylaw on financing. PHINDPDOTBL  % of public universities accredited, utilizing new quality assurance and accreditation measures developed in accordance with Bologna-defined EU norms and practices. (Percentage, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 0.00 80.00 Date 28-Mar-2014 04-Oct-2017 18-Apr-2018 30-Apr-2019 Comments The Universities were recently subject to external evaluation by the EUA. The findings from the external evaluations will be used in the re- accreditation process. PHINDPDOTBL  % increase in number of secondary TVET students benefiting from practical training in SME and large sized firms. (Percentage, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 36.30 14.20 36.30 30.00 Date 18-Apr-2018 23-Mar-2017 23-Mar-2017 30-Apr-2019 Comments The baseline was determined previously when the VET Center did not use standardized questionnaire for data collection for the students realizing practical training. The standardized method was introduced in 2015/2016 and therefore we changed the baseline value 36.30 (or 5/5/2018 Page 9 of 17 Public Disclosure Copy Public Disclosure Copy The World Bank Implementation Status & Results Report Skills Development & Innovation Support (P128378) 11.543 students) . Also, it was agreed that the increase will be measured as a % of enrolled students in 2nd,3rd and 4th year every school year and not from the baseline, since the number of enrolled students vary each year. The updated value for this indicator will be available in October 2018. PHINDPDOTBL  Share of private funding mobilized as a percentage of FITD investments in innovation activities. (Percentage, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 24.91 29.36 25.00 Date 28-Mar-2014 04-Oct-2017 18-Apr-2018 30-Apr-2019 PHINDPDOTBL  % of beneficiaries that sign collaborative agreements between firms and academia. (Percentage, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 14.28 14.28 20.00 Date 28-Mar-2014 04-Oct-2017 18-Apr-2018 30-Apr-2019 Overall Comments In the last two rounds there was not any new collaborative agreements between firms and academia Intermediate Results Indicators PHINDIRITBL  Implementation of new higher education funding model. (Text, Custom) Baseline Actual (Previous) Actual (Current) End Target The new funding model will be determined after The possible funding the adoption of the draft New funding The new funding model is Value models has been Law on the Higher model not developed loped presented to MOES. Education, which is implemented expected by the June, 2018. Date 28-Mar-2014 04-Oct-2017 18-Apr-2018 31-Jan-2019 5/5/2018 Page 10 of 17 Public Disclosure Copy Public Disclosure Copy The World Bank Implementation Status & Results Report Skills Development & Innovation Support (P128378) PHINDIRITBL  Board of Quality Assurance and Accreditation achieves membership in ENQA (the European Association for Quality Assurance in Higher Education) (Text, Custom) Baseline Actual (Previous) Actual (Current) End Target The draft law on Higher Board of Education envisages Quality Board of Quality The new law for Higher development of a new Assurance and Assurance and education quality Agency for Quality Value Accreditation Accreditation NOT a insurance is in process Assurance and achieves full member of ENQA of preparation. alignment of its by-laws member status in accordance with the in ENQA European standards and guidelines. Date 28-Mar-2014 10-Oct-2017 18-Apr-2018 31-Jan-2019 PHINDIRITBL  Number of public universities that have completed an external evaluation utilizing new quality assurance measures developed in accordance with Bologna-defined EU norms and practices. (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 6.00 5.00 Date 28-Mar-2014 10-Oct-2017 18-Apr-2018 30-Apr-2019 Comments EUA has completed evaluation of all six (6) HEIs, and has delivered 6 individual reports to the HEIs and one on system wide report to the MoES. PHINDIRITBL  National TTO established and operational (Text, Custom) Baseline Actual (Previous) Actual (Current) End Target TTO Value Not in existence No No operational Date 28-Mar-2014 10-Oct-2017 18-Apr-2018 30-Sep-2016 5/5/2018 Page 11 of 17 Public Disclosure Copy Public Disclosure Copy The World Bank Implementation Status & Results Report Skills Development & Innovation Support (P128378) PHINDIRITBL  IP related cases handled for industry as measured by number of patent landscape analysis(PA), patents filed(P) and technology in-licensing(importation of technology) (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 0.00 30.00 Date 28-Mar-2014 10-Oct-2017 19-Apr-2018 31-Jan-2019 PHINDIRITBL  Domestic inventions by RTIs commercialized as measured by number of patents filed, licenses, and contract research (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 0.00 15.00 Date 10-Sep-2013 10-Oct-2017 19-Apr-2018 31-Jan-2019 PHINDIRITBL  TVET action plan that promotes general and broader technical education and competence- based learning adopted (Text, Custom) Baseline Actual (Previous) Actual (Current) End Target Value Not in existence Model adopted. Model adopted. Model adopted Date 10-Sep-2013 10-Oct-2017 10-Oct-2017 31-Jan-2016 PHINDIRITBL  % of developed TVET occupational standards by professional fields (Percentage, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 49.00 100.00 100.00 Date 10-Sep-2013 10-Oct-2017 18-Apr-2018 31-Jan-2019 5/5/2018 Page 12 of 17 Public Disclosure Copy Public Disclosure Copy The World Bank Implementation Status & Results Report Skills Development & Innovation Support (P128378) PHINDIRITBL  Share of updated TVET secondary school programs targeting key sectors of the local economy. (Percentage, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 0.00 70.00 Date 10-Sep-2013 10-Oct-2017 18-Apr-2018 31-Jan-2019 Comments Report for assessment of the VET schools network, cost benefit analysis and operational plan for rationalization of the network is done. PHINDIRITBL  % of updated TVET curricula in line with occupational standards (Percentage, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 4.45 6.00 100.00 Date 10-Sep-2013 10-Oct-2017 19-Apr-2018 31-Jan-2019 Comments National Curriculum Framework was approved by the MOES , which allows all curricula to be developed in the next several months. Working groups are appointed and have already started working on curricula development. It is expected this to be completed by December 2018. PHINDIRITBL  % Increase in number of companies providing practical training to secondary TVET students. (Percentage, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 24.00 20.00 30.00 Date 15-Jan-2015 10-Oct-2017 18-Apr-2018 31-Mar-2019 5/5/2018 Page 13 of 17 Public Disclosure Copy Public Disclosure Copy The World Bank Implementation Status & Results Report Skills Development & Innovation Support (P128378) PHINDIRITBL  Manual and training materials for quality delivery of new curricula adopted (Yes/No, Custom) Baseline Actual (Previous) Actual (Current) End Target Value N Y Y Y Date 10-Sep-2013 10-Oct-2017 10-Oct-2017 31-May-2018 PHINDIRITBL  Share of resources dedicated to Fund for Innovation and Technology Development (FITD) instruments disbursed (Percentage, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 10.09 19.54 100.00 Date 10-Sep-2013 10-Oct-2017 10-Oct-2017 31-Jan-2019 PHINDIRITBL  Number of companies established via the FITD Accelerator program (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 0.00 15.00 Date 10-Sep-2013 10-Oct-2017 19-Apr-2018 31-Jan-2019 Comments The rulebook for Accelerator program was approved by the Bank in March, 2018. PHINDIRITBL  Number of beneficiary firms to introduce new/improved products (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 36.00 51.00 30.00 Date 10-Sep-2013 10-Oct-2017 19-Apr-2018 31-Jan-2019 5/5/2018 Page 14 of 17 Public Disclosure Copy Public Disclosure Copy The World Bank Implementation Status & Results Report Skills Development & Innovation Support (P128378) PHINDIRITBL  Number of beneficiary firms to introduce new processes (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 0.00 4.00 Date 10-Sep-2013 10-Oct-2017 19-Apr-2018 31-Jan-2019 PHINDIRITBL  % of beneficiaries receiving training and mentoring (Percentage, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 100.00 100.00 70.00 Date 28-Mar-2014 10-Oct-2017 19-Apr-2018 30-Apr-2019 PHINDIRITBL  Evaluations for Innovation grants designed, conducted and reports reported (Text, Custom) Baseline Actual (Previous) Actual (Current) End Target The survey is ongoing. It is expected more Evaluation Evaluation design companies to be reports Value Not in existence developed and included in the survey completed and approved by the FITD. since not all companies results that were included have disseminated responded. Date 10-Sep-2013 10-Oct-2017 19-Apr-2018 30-Nov-2016 PHINDIRITBL  Skills Observatory established, providing information about TVET and HE performance to the public (Text, Custom) Baseline Actual (Previous) Actual (Current) End Target The activities for interconnection with Management The info on Tracer studies Information Systems of platform being Value Not in existence conducted and report is private universities are updated at in draft phase. ongoing. least twice per The activities for First year Macedonian Tracer study are finished. Date 10-Sep-2013 10-Oct-2017 19-Apr-2018 31-Jan-2019 5/5/2018 Page 15 of 17 Public Disclosure Copy Public Disclosure Copy The World Bank Implementation Status & Results Report Skills Development & Innovation Support (P128378) Overall Comments Data on Financial Performance Disbursements (by loan) Project Loan/Credit/TF Status Currency Original Revised Cancelled Disbursed Undisbursed Disbursed P128378 IBRD-83320 Effective USD 24.00 24.00 0.00 6.45 16.61 28% Key Dates (by loan) Project Loan/Credit/TF Status Approval Date Signing Date Effectiveness Date Orig. Closing Date Rev. Closing Date P128378 IBRD-83320 Effective 28-Jan-2014 07-Feb-2014 11-Mar-2014 31-May-2019 31-May-2019 Cumulative Disbursements 5/5/2018 Page 16 of 17 Public Disclosure Copy Public Disclosure Copy The World Bank Implementation Status & Results Report Skills Development & Innovation Support (P128378) Restructuring History There has been no restructuring to date. Related Project(s) There are no related projects. 5/5/2018 Page 17 of 17 Public Disclosure Copy