Public Disclosure Copy The World Bank Implementation Status & Results Report Skills Development & Innovation Support (P128378) Skills Development & Innovation Support (P128378) EUROPE AND CENTRAL ASIA | Macedonia, former Yugoslav Republic of | Education Global Practice | IBRD/IDA | Investment Project Financing | FY 2014 | Seq No: 7 | ARCHIVED on 12-Apr-2017 | ISR27450 | Implementing Agencies: Key Dates Key Project Dates Bank Approval Date:28-Jan-2014 Effectiveness Date:11-Mar-2014 Planned Mid Term Review Date:25-Sep-2017 Actual Mid-Term Review Date:-- Original Closing Date:31-May-2019 Revised Closing Date:31-May-2019 Project Development Objectives Project Development Objective (from Project Appraisal Document) The Project Development Objective (PDO) is to improve transparency of resource allocation and promote accountability in higher education, enhance the relevance of secondary technical vocational education, and support innovation capacity in Macedonia. Has the Project Development Objective been changed since Board Approval of the Project Objective? No PHRPDODEL Components Name Improving Transparency of Higher Education:(Cost $4.00 M) Modernization of Secondary Technical Vocational Education and Training:(Cost $4.50 M) Improving the innovative capacity of enterprises and collaboration with research organizations:(Cost $12.94 M) Project Management and Monitoring and Evaluation:(Cost $2.50 M) Overall Ratings Name Previous Rating Current Rating Progress towards achievement of PDO  Moderately Satisfactory  Moderately Satisfactory Overall Implementation Progress (IP)  Moderately Unsatisfactory  Moderately Satisfactory Overall Risk Rating  Substantial  Substantial 4/12/2017 Page 1 of 17 Public Disclosure Copy Public Disclosure Copy The World Bank Implementation Status & Results Report Skills Development & Innovation Support (P128378) Implementation Status and Key Decisions Project implementation has improved recently and most of the technical impediments have been resolved. However, despite good progress in implementing all project activities, two important decisions are pending the establishment of the new government: (i) policy decisions regarding the new higher education funding formula; and (ii) governance structure of the Higher Education Accreditation and Evaluation Board (HEAEB) Board. 4/12/2017 Page 2 of 17 Public Disclosure Copy Public Disclosure Copy The World Bank Implementation Status & Results Report Skills Development & Innovation Support (P128378) 4/12/2017 Page 3 of 17 Public Disclosure Copy Public Disclosure Copy The World Bank Implementation Status & Results Report Skills Development & Innovation Support (P128378) 4/12/2017 Page 4 of 17 Public Disclosure Copy Public Disclosure Copy The World Bank Implementation Status & Results Report Skills Development & Innovation Support (P128378) 4/12/2017 Page 5 of 17 Public Disclosure Copy Public Disclosure Copy The World Bank Implementation Status & Results Report Skills Development & Innovation Support (P128378) 4/12/2017 Page 6 of 17 Public Disclosure Copy Public Disclosure Copy The World Bank Implementation Status & Results Report Skills Development & Innovation Support (P128378) 4/12/2017 Page 7 of 17 Public Disclosure Copy Public Disclosure Copy The World Bank Implementation Status & Results Report Skills Development & Innovation Support (P128378) Risks Systematic Operations Risk-rating Tool Risk Category Rating at Approval Previous Rating Current Rating Political and Governance  --  Moderate  Substantial Macroeconomic  --  Substantial  Substantial Sector Strategies and Policies  --  Moderate  Moderate Technical Design of Project or Program  --  Moderate  Moderate Institutional Capacity for Implementation and Sustainability  --  Substantial  Moderate Fiduciary  --  Moderate  Moderate Environment and Social  --  Low  Low Stakeholders  --  Moderate  Moderate 4/12/2017 Page 8 of 17 Public Disclosure Copy Public Disclosure Copy The World Bank Implementation Status & Results Report Skills Development & Innovation Support (P128378) Other  --  --  -- Overall  --  Substantial  Substantial Results Project Development Objective Indicators PHINDPDOTBL  % of public universities receiving financing based on new, transparent funding model. (Percentage, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 0.00 80.00 Date 28-Mar-2014 04-Oct-2016 23-Mar-2017 30-Apr-2019 Comments The assessment of the current funding model has been performed by a consultant. The proposal for the new funding model was presented by the consultant in March 2017. PHINDPDOTBL  % of public universities accredited, utilizing new quality assurance and accreditation measures developed in accordance with Bologna-defined EU norms and practices. (Percentage, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 0.00 80.00 Date 28-Mar-2014 04-Oct-2016 23-Mar-2017 30-Apr-2019 Comments External evaluation of all state universities has started. The review of universities will take place in the period April - June 2017. PHINDPDOTBL  % increase in number of secondary TVET students benefiting from practical training in SME and large sized firms. (Percentage, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 13.50 14.20 14.20 30.00 Date 02-Oct-2014 04-Oct-2016 23-Mar-2017 30-Apr-2019 4/12/2017 Page 9 of 17 Public Disclosure Copy Public Disclosure Copy The World Bank Implementation Status & Results Report Skills Development & Innovation Support (P128378) Comments At the end of 2016, the VET Center developed a standardized questionnaire for data collection regarding the students realizing practical training, the total number of employers where students get the training etc. Until the end of 2016, the data was collected in an irregular manner and it was not standardized for all the schools. The number of students benefiting from practical training in SMEs and large-sized firms for 2015/2016 school year was 11.543. The team will use this number as an input to calculate a new baseline value. The additional justification for changing the original baseline value is that the grant program aimed at increasing the number of TVET students benefiting from practical training starting in school year -2016/17. The team knows that this change requires restructuring of the project and will therefore formally initiate the change of the baseline value after the mid-term review, planned for September this year. PHINDPDOTBL  Share of private funding mobilized as a percentage of FITD investments in innovation activities. (Percentage, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 41.30 24.91 25.00 Date 28-Mar-2014 04-Oct-2016 23-Mar-2017 30-Apr-2019 PHINDPDOTBL  % of beneficiaries that sign collaborative agreements between firms and academia. (Percentage, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 14.28 14.28 20.00 Date 28-Mar-2014 04-Oct-2016 23-Mar-2017 30-Apr-2019 Overall Comments Intermediate Results Indicators 4/12/2017 Page 10 of 17 Public Disclosure Copy Public Disclosure Copy The World Bank Implementation Status & Results Report Skills Development & Innovation Support (P128378) PHINDIRITBL  Implementation of new higher education funding model. (Text, Custom) Baseline Actual (Previous) Actual (Current) End Target New funding model will The possible funding New funding The new funding model is Value be presented to the models has been model not developed loped MOES in November. presented to MOES. implemented Date 28-Mar-2014 04-Oct-2016 23-Mar-2017 31-Jan-2019 Comments The model was presented to MOES and Universities. The model is not adopted yet because the current technical government has no mandate to approve new funding models. PHINDIRITBL  Board of Quality Assurance and Accreditation achieves membership in ENQA (the European Association for Quality Assurance in Higher Education) (Text, Custom) Baseline Actual (Previous) Actual (Current) End Target Board of Quality Board of Quality The HEAEB The new law for Higher Assurance and Assurance and organizational structure education quality Value Accreditation Accreditation NOT a model is discussed and insurance is in process achieves full member of ENQA agreed of preparation. member status in ENQA Date 28-Mar-2014 04-Oct-2016 23-Mar-2017 31-Jan-2019 Comments The consultant for the need assessment for capacity building of the Board has submitted report for the new organizational structure of the HAEAB for fulfilling the requirements for full ENQA membership. The new law for Higher education quality insurance is being preparation. PHINDIRITBL  Number of public universities that have completed an external evaluation utilizing new quality assurance measures developed in accordance with Bologna-defined EU norms and practices. (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 0.00 5.00 Date 28-Mar-2014 04-Oct-2016 23-Mar-2017 30-Apr-2019 Comments 4/12/2017 Page 11 of 17 Public Disclosure Copy Public Disclosure Copy The World Bank Implementation Status & Results Report Skills Development & Innovation Support (P128378) The external evaluation has been launched. The reports are expected by March 2018. PHINDIRITBL  National TTO established and operational (Text, Custom) Baseline Actual (Previous) Actual (Current) End Target Most likely the NTTO will be established at TTO Value Not in existence No the beginning of the operational next year Date 28-Mar-2014 04-Oct-2016 23-Mar-2017 30-Sep-2016 Comments The NTTO is about to be established. The only outstanding issue is nomination of a Director. PHINDIRITBL  IP related cases handled for industry as measured by number of patent landscape analysis(PA), patents filed(P) and technology in-licensing(importation of technology) (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 0.00 30.00 Date 28-Mar-2014 04-Oct-2016 23-Mar-2017 31-Jan-2019 PHINDIRITBL  Domestic inventions by RTIs commercialized as measured by number of patents filed, licenses, and contract research (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 0.00 15.00 Date 10-Sep-2013 04-Oct-2016 23-Mar-2017 31-Jan-2019 4/12/2017 Page 12 of 17 Public Disclosure Copy Public Disclosure Copy The World Bank Implementation Status & Results Report Skills Development & Innovation Support (P128378) PHINDIRITBL  TVET action plan that promotes general and broader technical education and competence- based learning adopted (Text, Custom) Baseline Actual (Previous) Actual (Current) End Target Value Not in existence In progress Model adopted. Model adopted Date 10-Sep-2013 04-Oct-2016 23-Mar-2017 31-Jan-2016 Comments The Concept paper for TVET modernization was adopted on December 2, 2016 ; this will serve as the basis upon which all relevant documents (methodologies, standards for sectors, occupations, qualifications, syllabi and competency -based modular curricula) will be developed. PHINDIRITBL  % of developed TVET occupational standards by professional fields (Percentage, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 0.00 100.00 Date 10-Sep-2013 04-Oct-2016 23-Mar-2017 31-Jan-2019 Comments Based on the developed Methodology for development of the standards for sectors analysis, the 14 established NETs have been working on the development on the standards for analysis of the sectors , that will be finalized by the mid of April. PHINDIRITBL  Share of updated TVET secondary school programs targeting key sectors of the local economy. (Percentage, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 0.00 70.00 Date 10-Sep-2013 04-Oct-2016 23-Mar-2017 31-Jan-2019 4/12/2017 Page 13 of 17 Public Disclosure Copy Public Disclosure Copy The World Bank Implementation Status & Results Report Skills Development & Innovation Support (P128378) PHINDIRITBL  % of updated TVET curricula in line with occupational standards (Percentage, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 0.00 100.00 Date 10-Sep-2013 04-Oct-2016 23-Mar-2017 31-Jan-2019 PHINDIRITBL  % Increase in number of companies providing practical training to secondary TVET students. (Percentage, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 20.00 24.00 30.00 Date 15-Jan-2015 04-Oct-2016 23-Mar-2017 31-Mar-2019 PHINDIRITBL  Manual and training materials for quality delivery of new curricula adopted (Yes/No, Custom) Baseline Actual (Previous) Actual (Current) End Target Value N N N Y Date 10-Sep-2013 04-Oct-2016 23-Mar-2017 31-May-2018 PHINDIRITBL  Share of resources dedicated to Fund for Innovation and Technology Development (FITD) instruments disbursed (Percentage, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 4.59 4.59 100.00 Date 10-Sep-2013 04-Oct-2016 23-Mar-2017 31-Jan-2019 4/12/2017 Page 14 of 17 Public Disclosure Copy Public Disclosure Copy The World Bank Implementation Status & Results Report Skills Development & Innovation Support (P128378) PHINDIRITBL  Number of companies established via the FITD Accelerator program (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 0.00 15.00 Date 10-Sep-2013 04-Oct-2016 23-Mar-2017 31-Jan-2019 PHINDIRITBL  Number of beneficiary firms to introduce new/improved products (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 33.00 33.00 30.00 Date 10-Sep-2013 04-Oct-2016 23-Mar-2017 31-Jan-2019 Comments A new call was announced in February 2017.Results from the call are expected in August 2017. PHINDIRITBL  Number of beneficiary firms to introduce new processes (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 0.00 4.00 Date 10-Sep-2013 04-Oct-2016 23-Mar-2017 31-Jan-2019 Comments The FITD has been working on modification of the rulebook to include the World Bank recommendations. 4/12/2017 Page 15 of 17 Public Disclosure Copy Public Disclosure Copy The World Bank Implementation Status & Results Report Skills Development & Innovation Support (P128378) PHINDIRITBL  % of beneficiaries receiving training and mentoring (Percentage, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 100.00 100.00 70.00 Date 28-Mar-2014 04-Oct-2016 23-Mar-2017 30-Apr-2019 PHINDIRITBL  Evaluations for Innovation grants designed, conducted and reports reported (Text, Custom) Baseline Actual (Previous) Actual (Current) End Target Evaluation Evaluation design reports Value Not in existence In progress developed and approved completed and by the FITD. results disseminated Date 10-Sep-2013 04-Oct-2016 23-Mar-2017 30-Nov-2016 PHINDIRITBL  Skills Observatory established, providing information about TVET and HE performance to the public (Text, Custom) Baseline Actual (Previous) Actual (Current) End Target The info on Mechanisms for data Tracer studies platform being collection agreed and Value Not in existence conducted and report is updated at tracer studies in draft phase. least twice per conducted year Date 10-Sep-2013 04-Oct-2016 23-Mar-2017 31-Jan-2019 Overall Comments Data on Financial Performance Disbursements (by loan) Project Loan/Credit/TF Status Currency Original Revised Cancelled Disbursed Undisbursed Disbursed P128378 IBRD-83320 Effective USD 24.00 24.00 0.00 4.27 19.10 18% 4/12/2017 Page 16 of 17 Public Disclosure Copy Public Disclosure Copy The World Bank Implementation Status & Results Report Skills Development & Innovation Support (P128378) Key Dates (by loan) Project Loan/Credit/TF Status Approval Date Signing Date Effectiveness Date Orig. Closing Date Rev. Closing Date P128378 IBRD-83320 Effective 28-Jan-2014 07-Feb-2014 11-Mar-2014 31-May-2019 31-May-2019 Cumulative Disbursements Restructuring History There has been no restructuring to date. Related Project(s) There are no related projects. 4/12/2017 Page 17 of 17 Public Disclosure Copy