Public Disclosure Copy The World Bank Implementation Status & Results Report Skills Development & Innovation Support (P128378) Skills Development & Innovation Support (P128378) EUROPE AND CENTRAL ASIA | Macedonia, former Yugoslav Republic of | Education Global Practice | IBRD/IDA | Investment Project Financing | FY 2014 | Seq No: 8 | ARCHIVED on 22-Oct-2017 | ISR29852 | Implementing Agencies: Ministry of Finance, Ministry of Education and Science Key Dates Key Project Dates Bank Approval Date:28-Jan-2014 Effectiveness Date:11-Mar-2014 Planned Mid Term Review Date:25-Sep-2017 Actual Mid-Term Review Date:25-Sep-2017 Original Closing Date:31-May-2019 Revised Closing Date:31-May-2019 Project Development Objectives Project Development Objective (from Project Appraisal Document) The Project Development Objective (PDO) is to improve transparency of resource allocation and promote accountability in higher education, enhance the relevance of secondary technical vocational education, and support innovation capacity in Macedonia. Has the Project Development Objective been changed since Board Approval of the Project Objective? No PHRPDODEL Components Name Improving Transparency of Higher Education:(Cost $4.00 M) Modernization of Secondary Technical Vocational Education and Training:(Cost $4.50 M) Improving the innovative capacity of enterprises and collaboration with research organizations:(Cost $12.94 M) Project Management and Monitoring and Evaluation:(Cost $2.50 M) Overall Ratings Name Previous Rating Current Rating Progress towards achievement of PDO  Moderately Satisfactory  Moderately Satisfactory Overall Implementation Progress (IP)  Moderately Satisfactory  Moderately Satisfactory Overall Risk Rating  Substantial  Substantial 10/22/2017 Page 1 of 18 Public Disclosure Copy Public Disclosure Copy The World Bank Implementation Status & Results Report Skills Development & Innovation Support (P128378) Implementation Status and Key Decisions The likelihood that the project will achieve its outcomes by the current end-date is moderate. The activities that are significantly lagging behind schedule are related to the Higher Education component and the Innovation Component, specifically implementation of the new funding formula and two Innovation Instruments- Technology Extension and Accelerator. The new leadership in the Ministry of Education is committed to the Project objectives given Minister’s expressed opinion that the project activities highly correspond with the government vision regarding the reforms in the education sector and the innovation eco system. The new Minister and the new Director of the Fund for Innovation and Technological Development (FITD) agreed to mobilize their teams in order to speed up project implementation. The Bank team believes that this project will most likely need to be extended for one year in order to allow for implementation of the financing and quality assurance reforms in Higher Education as well as establishment of at least one Accelerator in the country. However, the extension would be reasonable only if there is a sufficient progress in implementation of the currently stalled activities. In the next six months, the team will closely monitor the implementation of the agreed actions and will suggest follow-up actions with the government if the implementation progress does not happen within the agreed timeframe. Given the appropriate funds allocation in the budget for the project and the government commitment to the project objectives, the Bank team is confident that accomplishment of the above-mentioned outputs is doable. 10/22/2017 Page 2 of 18 Public Disclosure Copy Public Disclosure Copy The World Bank Implementation Status & Results Report Skills Development & Innovation Support (P128378) 10/22/2017 Page 3 of 18 Public Disclosure Copy Public Disclosure Copy The World Bank Implementation Status & Results Report Skills Development & Innovation Support (P128378) 10/22/2017 Page 4 of 18 Public Disclosure Copy Public Disclosure Copy The World Bank Implementation Status & Results Report Skills Development & Innovation Support (P128378) 10/22/2017 Page 5 of 18 Public Disclosure Copy Public Disclosure Copy The World Bank Implementation Status & Results Report Skills Development & Innovation Support (P128378) 10/22/2017 Page 6 of 18 Public Disclosure Copy Public Disclosure Copy The World Bank Implementation Status & Results Report Skills Development & Innovation Support (P128378) 10/22/2017 Page 7 of 18 Public Disclosure Copy Public Disclosure Copy The World Bank Implementation Status & Results Report Skills Development & Innovation Support (P128378) Risks Systematic Operations Risk-rating Tool Risk Category Rating at Approval Previous Rating Current Rating Political and Governance  --  Substantial  Substantial Macroeconomic  --  Substantial  Substantial 10/22/2017 Page 8 of 18 Public Disclosure Copy Public Disclosure Copy The World Bank Implementation Status & Results Report Skills Development & Innovation Support (P128378) Sector Strategies and Policies  --  Moderate  Moderate Technical Design of Project or Program  --  Moderate  Moderate Institutional Capacity for Implementation and Sustainability  --  Moderate  Moderate Fiduciary  --  Moderate  Low Environment and Social  --  Low  Low Stakeholders  --  Moderate  Moderate Other  --  --  -- Overall  --  Substantial  Substantial Results Project Development Objective Indicators PHINDPDOTBL  % of public universities receiving financing based on new, transparent funding model. (Percentage, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 0.00 80.00 Date 28-Mar-2014 23-Mar-2017 04-Oct-2017 30-Apr-2019 Comments After conducting detailed analysis of the Higher Education (HE) system and having numerous meetings with stakeholders, options for new funding models have been presented by the consultant to the new Minister and the new working group for HE. Namely, the new government has established a working group to review and revise the HE law. During the MTR mission, the Minister of Education confirmed that the new law on HE will also include a new financing model, based on the proposal given in the consultant's report. The revised law on HE will be available for comments by the end of this year. PHINDPDOTBL  % of public universities accredited, utilizing new quality assurance and accreditation measures developed in accordance with Bologna-defined EU norms and practices. (Percentage, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 0.00 80.00 Date 28-Mar-2014 23-Mar-2017 04-Oct-2017 30-Apr-2019 Comments External evaluation of universities conducted by the European University Association is ongoing. The Institutional reports will be available by February 2018 and the comprehensive system level report by March 2018. 10/22/2017 Page 9 of 18 Public Disclosure Copy Public Disclosure Copy The World Bank Implementation Status & Results Report Skills Development & Innovation Support (P128378) PHINDPDOTBL  % increase in number of secondary TVET students benefiting from practical training in SME and large sized firms. (Percentage, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 13.50 14.20 14.20 30.00 Date 02-Oct-2014 23-Mar-2017 23-Mar-2017 30-Apr-2019 Comments The data for the school year 2016/17 will be available by mid- November! PHINDPDOTBL  Share of private funding mobilized as a percentage of FITD investments in innovation activities. (Percentage, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 24.91 24.91 25.00 Date 28-Mar-2014 23-Mar-2017 04-Oct-2017 30-Apr-2019 PHINDPDOTBL  % of beneficiaries that sign collaborative agreements between firms and academia. (Percentage, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 14.28 14.28 20.00 Date 28-Mar-2014 23-Mar-2017 04-Oct-2017 30-Apr-2019 Overall Comments 10/22/2017 Page 10 of 18 Public Disclosure Copy Public Disclosure Copy The World Bank Implementation Status & Results Report Skills Development & Innovation Support (P128378) Intermediate Results Indicators PHINDIRITBL  Implementation of new higher education funding model. (Text, Custom) Baseline Actual (Previous) Actual (Current) End Target The possible funding The possible funding New funding The new funding model is Value models has been models has been model not developed loped presented to MOES. presented to MOES. implemented Date 28-Mar-2014 23-Mar-2017 04-Oct-2017 31-Jan-2019 Comments The report is prepared and presented to the new Minister and the working group for HE. It summarizes the constraints of the current funding model and presents possible funding options for overcoming the current bottlenecks leading to quality improvement in the sector. PHINDIRITBL  Board of Quality Assurance and Accreditation achieves membership in ENQA (the European Association for Quality Assurance in Higher Education) (Text, Custom) Baseline Actual (Previous) Actual (Current) End Target Board of Quality Board of Quality The new law for Higher The new law for Higher Assurance and Assurance and education quality education quality Value Accreditation Accreditation NOT a insurance is in process insurance is in process achieves full member of ENQA of preparation. of preparation. member status in ENQA Date 28-Mar-2014 23-Mar-2017 10-Oct-2017 31-Jan-2019 Comments Functional review of the quality assurance environment has been completed. A key recommendation within the review is a revision of the law on higher education in order to allow for a new organizational structure of the HEAEB. The working group will use the recommendation from the report to underpin the revision of the law for HE. 10/22/2017 Page 11 of 18 Public Disclosure Copy Public Disclosure Copy The World Bank Implementation Status & Results Report Skills Development & Innovation Support (P128378) PHINDIRITBL  Number of public universities that have completed an external evaluation utilizing new quality assurance measures developed in accordance with Bologna-defined EU norms and practices. (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 0.00 5.00 Date 28-Mar-2014 23-Mar-2017 10-Oct-2017 30-Apr-2019 Comments The EUA evaluation teams completed the first site visit at all Universities. The follow -up site visits are about to be finalized . According to the implementation plan EUA should submit six Individual reports for each university by February, 2018 and a system wide report by March, 2018. PHINDIRITBL  National TTO established and operational (Text, Custom) Baseline Actual (Previous) Actual (Current) End Target TTO Value Not in existence No No operational Date 28-Mar-2014 23-Mar-2017 10-Oct-2017 30-Sep-2016 Comments The Government considers to embed the NTTO within the Fund for Innovation and Technological Development. The WB team discussed this option with the government during the MTR mission. The WB provided a note that discusses pros and cons of establishing the NTTO in the institutional structure. PHINDIRITBL  IP related cases handled for industry as measured by number of patent landscape analysis(PA), patents filed(P) and technology in-licensing(importation of technology) (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 0.00 30.00 Date 28-Mar-2014 23-Mar-2017 10-Oct-2017 31-Jan-2019 10/22/2017 Page 12 of 18 Public Disclosure Copy Public Disclosure Copy The World Bank Implementation Status & Results Report Skills Development & Innovation Support (P128378) PHINDIRITBL  Domestic inventions by RTIs commercialized as measured by number of patents filed, licenses, and contract research (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 0.00 15.00 Date 10-Sep-2013 23-Mar-2017 10-Oct-2017 31-Jan-2019 PHINDIRITBL  TVET action plan that promotes general and broader technical education and competence- based learning adopted (Text, Custom) Baseline Actual (Previous) Actual (Current) End Target Value Not in existence Model adopted. Model adopted. Model adopted Date 10-Sep-2013 23-Mar-2017 10-Oct-2017 31-Jan-2016 PHINDIRITBL  % of developed TVET occupational standards by professional fields (Percentage, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 49.00 100.00 Date 10-Sep-2013 23-Mar-2017 10-Oct-2017 31-Jan-2019 PHINDIRITBL  Share of updated TVET secondary school programs targeting key sectors of the local economy. (Percentage, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 0.00 70.00 Date 10-Sep-2013 23-Mar-2017 10-Oct-2017 31-Jan-2019 Comments During the MTR mission it was agreed that this indicator will be modified ! The Ministry of Education will suggest wording for this indicator soon. 10/22/2017 Page 13 of 18 Public Disclosure Copy Public Disclosure Copy The World Bank Implementation Status & Results Report Skills Development & Innovation Support (P128378) PHINDIRITBL  % of updated TVET curricula in line with occupational standards (Percentage, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 4.45 100.00 Date 10-Sep-2013 23-Mar-2017 10-Oct-2017 31-Jan-2019 PHINDIRITBL  % Increase in number of companies providing practical training to secondary TVET students. (Percentage, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 24.00 24.00 30.00 Date 15-Jan-2015 23-Mar-2017 10-Oct-2017 31-Mar-2019 Comments Updated number of students will be available in October 2017 once the practical training is finished and data is collected. PHINDIRITBL  Manual and training materials for quality delivery of new curricula adopted (Yes/No, Custom) Baseline Actual (Previous) Actual (Current) End Target Value N N Y Y Date 10-Sep-2013 23-Mar-2017 10-Oct-2017 31-May-2018 Comments Manual and training materials developed and piloted! 10/22/2017 Page 14 of 18 Public Disclosure Copy Public Disclosure Copy The World Bank Implementation Status & Results Report Skills Development & Innovation Support (P128378) PHINDIRITBL  Share of resources dedicated to Fund for Innovation and Technology Development (FITD) instruments disbursed (Percentage, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 4.59 10.09 100.00 Date 10-Sep-2013 23-Mar-2017 10-Oct-2017 31-Jan-2019 PHINDIRITBL  Number of companies established via the FITD Accelerator program (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 0.00 15.00 Date 10-Sep-2013 23-Mar-2017 10-Oct-2017 31-Jan-2019 Comments The counterparts are about to finalize the Rulebook, i.e. addressing the comments provided by the World Bank. PHINDIRITBL  Number of beneficiary firms to introduce new/improved products (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 33.00 36.00 30.00 Date 10-Sep-2013 23-Mar-2017 10-Oct-2017 31-Jan-2019 PHINDIRITBL  Number of beneficiary firms to introduce new processes (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 0.00 4.00 Date 10-Sep-2013 23-Mar-2017 10-Oct-2017 31-Jan-2019 Comments The counterparts are about to finalize the Rulebook, i.e. addressing the comments provided by the World Bank. 10/22/2017 Page 15 of 18 Public Disclosure Copy Public Disclosure Copy The World Bank Implementation Status & Results Report Skills Development & Innovation Support (P128378) PHINDIRITBL  % of beneficiaries receiving training and mentoring (Percentage, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 100.00 100.00 70.00 Date 28-Mar-2014 23-Mar-2017 10-Oct-2017 30-Apr-2019 PHINDIRITBL  Evaluations for Innovation grants designed, conducted and reports reported (Text, Custom) Baseline Actual (Previous) Actual (Current) End Target Evaluation Evaluation design Evaluation design reports Value Not in existence developed and developed and approved completed and approved by the FITD. by the FITD. results disseminated Date 10-Sep-2013 23-Mar-2017 10-Oct-2017 30-Nov-2016 Comments The questionnaire has been designed. Training of the interviewers has been performed. It is expected that baseline data is to be collected by November 2017. 10/22/2017 Page 16 of 18 Public Disclosure Copy Public Disclosure Copy The World Bank Implementation Status & Results Report Skills Development & Innovation Support (P128378) PHINDIRITBL  Skills Observatory established, providing information about TVET and HE performance to the public (Text, Custom) Baseline Actual (Previous) Actual (Current) End Target The info on Tracer studies Tracer studies platform being Value Not in existence conducted and report is conducted and report is updated at in draft phase. in draft phase. least twice per year Date 10-Sep-2013 23-Mar-2017 10-Oct-2017 31-Jan-2019 Overall Comments Activities for SO are ongoing. Interconnection with Management Information Systems of National Employment Services, EMIS and all Universities is established and data has been collected. Data collection for Tracer study is finished. Data on Financial Performance Disbursements (by loan) Project Loan/Credit/TF Status Currency Original Revised Cancelled Disbursed Undisbursed Disbursed P128378 IBRD-83320 Effective USD 24.00 24.00 0.00 4.69 18.60 20% Key Dates (by loan) Project Loan/Credit/TF Status Approval Date Signing Date Effectiveness Date Orig. Closing Date Rev. Closing Date P128378 IBRD-83320 Effective 28-Jan-2014 07-Feb-2014 11-Mar-2014 31-May-2019 31-May-2019 Cumulative Disbursements 10/22/2017 Page 17 of 18 Public Disclosure Copy Public Disclosure Copy The World Bank Implementation Status & Results Report Skills Development & Innovation Support (P128378) Restructuring History There has been no restructuring to date. Related Project(s) There are no related projects. 10/22/2017 Page 18 of 18 Public Disclosure Copy