The World Bank Implementation Status & Results Report Tunisia Tertiary Education for Employability Project (P151059) Tunisia Tertiary Education for Employability Project (P151059) MIDDLE EAST AND NORTH AFRICA | Tunisia | Education Global Practice | IBRD/IDA | Investment Project Financing | FY 2016 | Seq No: 9 | ARCHIVED on 08-Jan-2020 | ISR40172 | Implementing Agencies: Ministry of Higher Education and Scientific Research, Ministry of Development, Investment and International Cooperation, National Agency for the Advancement of Scientific Research Key Dates Key Project Dates Bank Approval Date: 25-Feb-2016 Effectiveness Date: 30-Nov-2016 Planned Mid Term Review Date: 20-May-2019 Actual Mid-Term Review Date: 20-May-2019 Original Closing Date: 31-Dec-2021 Revised Closing Date: 31-Dec-2021 pdoTable Project Development Objectives Project Development Objective (from Project Appraisal Document) The objective of the Tertiary Education for Employability Project (TEEP) is to improve the employability of tertiary education graduates and to strengthen the management of higher education. Has the Project Development Objective been changed since Board Approval of the Project Objective? No Components Table Name Improving employability of tertiary education graduates:(Cost $36.00 M) Strengthening the management of higher education:(Cost $34.00 M) Overall Ratings Name Previous Rating Current Rating Progress towards achievement of PDO Moderately Unsatisfactory Moderately Unsatisfactory Overall Implementation Progress (IP) Moderately Unsatisfactory Moderately Unsatisfactory Overall Risk Rating Substantial Substantial Implementation Status and Key Decisions The Project achieved important milestones during the last six months. A Project restructuring was approved in September 2019 that strengthens the government's capacity to implement the Project and provides for more flexibility. Furthermore, the government approved several large competitive funds that finance large subprojects for public universities, regional directorates for students facilities and boards and more than 200 scholarships for PhD students and post-docs for 2020 and 2021. Another competitive fund to support tertiary education institutes was launched recently. A first round of proposals will be approved and financed by end of March 2020. All 13 universities and the Department of Technological Studies (Direction Générale des Etudes Technologiques) responsible for the Higher Institute of Technology have completed the drafting of their Orientation Strategic Plan. Finally in the last six months, an estimated US$5.7 million were disbursed in competitive funds. 1/8/2020 Page 1 of 7 The World Bank Implementation Status & Results Report Tunisia Tertiary Education for Employability Project (P151059) In early 2020 several important changes will be adopted to improve the Project achievement and implementation performance. One such change will consist in reviewing several outcomes and intermediate results indicators to better capture the contribution and impact of the Project activities. Risks Systematic Operations Risk-rating Tool Risk Category Rating at Approval Previous Rating Current Rating Political and Governance Substantial Substantial Substantial Macroeconomic Moderate Moderate Moderate Sector Strategies and Policies Substantial Moderate Moderate Technical Design of Project or Program Substantial Substantial Substantial Institutional Capacity for Implementation and Sustainability Substantial Substantial Substantial Fiduciary Substantial Moderate Moderate Environment and Social Moderate Low Low Stakeholders Moderate Moderate Moderate Other -- -- -- Overall Substantial Substantial Substantial Results PDO Indicators by Objectives / Outcomes Improve the employability of tertiary education graduates IN00790526 ►Share of higher education graduates from co-constructed programs (out of which share of female) that were employed 6 months after graduating, relative to appropriate comparison (Percentage, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 0.00 20.00 Date 18-Sep-2015 26-Jun-2019 23-Dec-2019 31-Dec-2021 This KPI can not be measured until all students enrolled in the co-constructed academic programs Comments: graduate. IN00790528 ►Number of tertiary education students who completed PAQ-supported employability programs. (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target 1/8/2020 Page 2 of 7 The World Bank Implementation Status & Results Report Tunisia Tertiary Education for Employability Project (P151059) Value 0.00 0.00 4,000.00 10,000.00 Date 18-Sep-2015 26-Jun-2019 23-Dec-2019 31-Dec-2021 It is estimated that around 4000 students participated in various employability programs financed through several competitive funds windows such as PAQ 4C, PAQ Price, PAQ PFE, PAQ PAES, PAQ Collabora and PAQ Co-Construction. A survey of students perceived improvement of their employability skills is Comments: ready and will be launched in early January 2020. Strengthen the management of higher education IN00790527 ►Percentage of public universities that have strategic plans. (Percentage, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 8.00 54.00 100.00 100.00 Date 18-Sep-2015 26-Jun-2019 23-Dec-2019 31-Dec-2021 All 13 public universities and the Department of Technological Studies (DGET) recently submitted their new Orientation Strategic Plan (OSP). Each university will validate its OSP their university board. Comments: Intermediate Results Indicators by Components Improving employability of tertiary education graduates IN00790529 ►Number co-constructed programs that have been established under the project (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 5.00 14.00 50.00 Date 18-Sep-2015 26-Jun-2019 23-Dec-2019 31-Dec-2021 14 PAQ "co-constructed" have been awarded since the launch of the Project. Comments: IN00790531 ►Share of graduates from co-constructed programs that report being satisfied with their level of employable skills (Percentage, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 0.00 25.00 Date 18-Sep-2015 26-Jun-2019 23-Dec-2019 31-Dec-2021 A survey of all employability-supported PAQs (4C; Price, PFE, PAES, Collabora and Co-construction) will Comments: be launched in early January to measure the level of satisfaction with the activities carried out. IN00790533 ►Number of newly introduced programs under PAQ with at least one module on entrepreneurship (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target 1/8/2020 Page 3 of 7 The World Bank Implementation Status & Results Report Tunisia Tertiary Education for Employability Project (P151059) Value 0.00 22.00 88.00 75.00 Date 18-Sep-2015 26-Jun-2019 23-Dec-2019 31-Dec-2021 All PAQ 4C and PAQ PRICE approved so far include activities supporting soft skills training and Comments: entrepreneurship training. IN00790535 ►Percentage of PAQ projects by young universities (Percentage, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 22.00 22.00 20.00 Date 18-Sep-2015 26-Jun-2019 23-Dec-2019 31-Dec-2021 28 PAQs from young universities approved out of total 127 PAQs Comments: IN00790537 ►Set up of an online information platform for the dissemination of tracer studies (Text, Custom) Baseline Actual (Previous) Actual (Current) End Target The online platform does The online platform Value No platform Platform functioning not exist yet. does not exist yet. Date 18-Sep-2015 26-Jun-2019 23-Dec-2019 31-Dec-2021 As mentioned previously, there is a functioning online platform www.4c.tn that publishes information on job prospects in the labor market for tertiary education graduates. However, there is no dedicated online platform (should be hosted on www.orientation.tn) that will publish information on tracer studies carried out by tertiary education institutions. Creating a dedicated online platform is essential to inform future Comments: students on career prospects. The Ministry is responsible for elaborating the technical specifications for this online platform. The work is just starting. A project called TUNED (financed by the EU) is currently carrying out a tracer studies of several universities and engineering schools. The information collected will be publish on the online platform. IN00790538 ►Percentage of university observatories that systematically publish the results of periodic tracer studies on their website (Percentage, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 0.00 80.00 Date 18-Sep-2015 26-Jun-2019 23-Dec-2019 31-Dec-2021 Most university observatories are not operational. Only a few Higher Education Institutes (HEI) carried out limited tracer studies of their graduates. This information is neither centralized, nor disseminated outside Comments: the HEIs. IN00790539 ►Share of secondary students (in their final year) that have been informed about higher education opportunities and subsequent labor market outcomes with information generated by tracer studies (Percentage, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 0.00 50.00 Date 18-Sep-2015 26-Jun-2019 23-Dec-2019 31-Dec-2021 A survey tool was recently prepared to ask public universities to collect information on communication and Comments: awareness activities they organized for high school students, if any. IN00790540 1/8/2020 Page 4 of 7 The World Bank Implementation Status & Results Report Tunisia Tertiary Education for Employability Project (P151059) ►Number of certifications of students in courses focusing on transferrable skills (IT, PM, language skills/communication, etc.) (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 0.00 21,500.00 Date 18-Sep-2015 26-Jun-2019 23-Dec-2019 31-Dec-2021 The information on the number of certifications granted is currently collected directly from PAQ beneficiaries. Several thousands of students have participated in training related to transferrable skills, but Comments: the number of graduates is not yet known. Strengthening the management of higher education IN00790530 ►Percentage of universities that have a functioning internal Quality Assurance (QA) unit (Percentage, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 0.00 90.00 Date 18-Sep-2015 26-Jun-2019 23-Dec-2019 31-Dec-2021 All universities have an internal QA unit. The level of functionality of each internal QA unit is being assessed as part of the call for proposals under the new PAQ-DGSU. The new PAQ will include financing Comments: to strengthen the universities' internal QA units. IN00790532 ►Establishment of a model, pilot and roadmap towards performance-based financing in higher education (Text, Custom) Baseline Actual (Previous) Actual (Current) End Target Pilot evaluated and A pilot will be launched to A pilot will be launched final proposal for Value No model take effect in 2020. to take effect in 2020. model and roadmap ready Date 18-Sep-2015 26-Jun-2019 23-Dec-2019 31-Dec-2021 Several meetings took place in the first semester of 2019 with government counterparts (including Ministry of Finance) to agree on the modalities to pilot the performance-based financing for public universities in Comments: 2020. A model of contracting agreements with results will be prepared before the end of 2019. IN00790534 ►Direct project beneficiaries (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 25,000.00 150,000.00 Date 18-Sep-2015 03-Dec-2018 23-Dec-2019 31-Dec-2021 Citizen Engagement (CE) Assessment The intermediate indicators 8 and 9 will be used to measure CE with the Project activities, particularly the level of satisfaction of beneficiaries with activities financed under the PAQs. As per the PAQ operational manual, each entity implementing a PAQ must carry out a satisfaction survey of its beneficiaries upon completion of PAQ activities. The assessment of the CE through satisfaction surveys is expected to start Comments: with the first round of PAQs approved in 2018. Results will be available in late 2019 or early 2020. The CE indicator will be disaggregated by gender. The original intermediate indicator 2 noted for CE only represents a small component – a component where the underlying activity has been substantially delayed and therefore will be not be used anymore. 1/8/2020 Page 5 of 7 The World Bank Implementation Status & Results Report Tunisia Tertiary Education for Employability Project (P151059) IN00790536 Female beneficiaries (Percentage, Custom Supplement) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 18,000.00 75,000.00 Overall Comments IR Many targets have not been updated for this ISR, because the counterpart is currently working on a new result framework that will include several new and revised indicators, better aligned with the Project activities. Efforts are deployed now to collect baseline data for the indicators and estimate new targets for the remaining two or three years of Project implementation. Data on Financial Performance Disbursements (by loan) Project Loan/Credit/TF Status Currency Original Revised Cancelled Disbursed Undisbursed % Disbursed P151059 IBRD-85900 Effective USD 70.00 70.00 0.00 14.16 56.01 20% Key Dates (by loan) Project Loan/Credit/TF Status Approval Date Signing Date Effectiveness Date Orig. Closing Date Rev. Closing Date P151059 IBRD-85900 Effective 25-Feb-2016 03-Mar-2016 30-Nov-2016 31-Dec-2021 31-Dec-2021 Cumulative Disbursements 1/8/2020 Page 6 of 7 The World Bank Implementation Status & Results Report Tunisia Tertiary Education for Employability Project (P151059) Restructuring History Level 2 Approved on 01-May-2018 ,Level 2 Approved on 23-Sep-2019 Related Project(s) There are no related projects. 1/8/2020 Page 7 of 7