The World Bank Implementation Status & Results Report Rwanda Priority Skills for Growth (PSG) (P252350) Rwanda Priority Skills for Growth (PSG) (P252350) AFRICA | Rwanda | Education Global Practice | Requesting Unit: AFCE2 | Responsible Unit: HAFE1 IBRD/IDA | Program-for-Results Financing | FY 2018 | Team Leader(s): Ruth Karimi Charo Seq No: 5 | ARCHIVED on 11-Oct-2019 | ISR38569 | Created by: Ruth Karimi Charo on 16-Sep-2019 | Modified by: Rosario Aristorenas on 07-Oct-2019 Program Development Objectives Program Development Objective (from Program Appraisal Document) The Program Development Objective is to expand opportunities for the acquisition of quality, market-relevant skills in selected economic sectors. The selected economic sectors include Energy, Transport and Logistics, and Manufacturing (with a focus on ‘Made in Rwanda’ products such as construction materials, light manufacturing and agro-processing). Building skills to advance the country’s economic agenda is a key priority of the GoR’s ongoing Economic Development and Poverty Reduction Strategy- 2 (EDPRS 2) launched in 2013. EDPRS 2 builds on the country’s Vision 2020 which seeks to transform the country by raising its per capita GDP to middle-incomelevel by 2020. The Program is grounded in the Government of Rwanda’s (GoR) National Employment Programs (NEP) approved by Cabinet in 2014. NEP was designed to address the employment challenges in Rwanda and equip its population with the skills required to supporteconomic development. The main results areas of the operation are: (i) reinforcing governance of the skills development system; (ii) ensuring provision of quality training programs with market relevance; (iii) expanding opportunities for continuous upgrading ofjob-relevant skills for sustained employability; and (iv) capacity building for implementation. The Program will disburse against achievement of specific Disbursement Linked Results (DLRs) in these results areas Overall Ratings Name Previous Rating Current Rating Progress towards achievement of PDO ►Moderately Satisfactory ►Satisfactory Overall Implementation Progress (IP) ►Satisfactory ►Satisfactory Implementation Status and Key Decisions Program implementation is progressing well. Most of the outstanding issues are resolved such as the completion of skills assessments; development of some of the target new and updated programs; establishment of the student loan recovery information system; training of the first cohort for the SDF; and implementation of capacity building activities for target entities. Completion of these preliminary activities was critical to facilitate progress towards achievement of Disbursement Linked Results (DLRs). Data on Financial Performance Disbursements (by loan) Project Loan/Credit/TF Status Currency Original Revised Cancelled Disbursed Undisbursed % Disbursed P252350 IDA-61190 Effective USD 120.00 120.00 0.00 96.98 24.32 80% 10/11/2019 Page 1 of 11 The World Bank Implementation Status & Results Report Rwanda Priority Skills for Growth (PSG) (P252350) Key Dates (by loan) Project Loan/Credit/TF Status Approval Date Signing Date Effectiveness Date Orig. Closing Date Rev. Closing Date P252350 IDA-61190 Effective 05-Jul-2017 17-Jul-2017 26-Oct-2017 30-Sep-2020 30-Sep-2020 DLI Disbursement Achievement Disbursed amount in Disbursement % for DLI ID DLI Type Description Coc DLI Amount Status Coc DLI Loan: IDA61190-001 1 Regular Implementation of NEP JPC XDR 18,240,000.00 Fully Achieved 18,240,000.00 1% New Updated Quality Partially 2 Regular XDR 22,250,000.00 3,136,382.00 7.1 % Training programs Achieved No. of accredited new/updated 3 Regular XDR 3,660,000.00 Not Achieved 0.00 progs Partially 4 Regular No. graduates receiving grants XDR 17,880,000.00 10,489,999.00 1.7 % Achieved Improved sustainability of Partially 5 Regular XDR 18,250,000.00 12,410,000.00 1.5 % financing for Achieved Completion of Capacity Partially 6 Regular XDR 7,320,000.00 4,880,000.00 1.5 % Building Achieved Program Action Plan Action Description Provision of advice on change management to heads of the institutions that will undergo restructuring Source DLI# Responsibility Timing Timing Value Status Technical Client Due Date 31-Dec-2019 Revised Date Completion Measurement RDB-CSO (formally CESB) and RP implements PSG activities as per the Subsidiary agreements. Tony Blair institute (TBI) and Rwanda Management Institute providing support and training raining on Change Management and Comments overall institutional management. Although the trainings on change management and project management was completed. Action Description Train a cadre of project management staff to better understand best practice, procedures and systems Source DLI# Responsibility Timing Timing Value Status Technical DLI 6 Client Due Date 31-Dec-2019 Revised Date Completion Measurement Trainings conducted 10/11/2019 Page 2 of 11 The World Bank Implementation Status & Results Report Rwanda Priority Skills for Growth (PSG) (P252350) Training on Project Management, Change Management and Monitoring and Evaluation was conducted by Rwanda management Comments institute for WDA, RP, HEC, MINEDUC and RDB. A second round of the trainings is planned for this quarter, which will also include staf Action Description Technical expertise to be engaged in the areas of curriculum, pedagogy, assessment, ICT and management Source DLI# Responsibility Timing Timing Value Status Technical DLI 6 Client-CESB Recurrent Continuous In Progress Completion Measurement New and updated programs developed using the DACUM method. Target TVET tutors have been trained on the DACUM (development of a curriculum) process. The Government recruited new Comments instructors for IPRCs under the newly created Rwanda Polytechnic. Action Description Upgrade the quality and number of instructors at TVET level Source DLI# Responsibility Timing Timing Value Status Technical DLI 6 Client-CESB Recurrent Continuous In Progress Completion Measurement TVET Instructors trained in DACUM. Increase in number of new instructors under RP. TVET Instructors have been trained on the DACUM (development of a curriculum) process. The Government recruited new Comments instructors for IPRCs under the newly created Rwanda Polytechnic. Action Description Increased capacity required in quality assurance and regulation of institutions Source DLI# Responsibility Timing Timing Value Status Technical DLI 6 Client-CESB Recurrent Continuous In Progress Milestones fully implemented for the MoU between Higher Education Council (HEC) and Mauritius Tertiary Education Commission Completion Measurement (TEC) for Quality assurance of the training programs. MoU between Higher Education Council (HEC) and Mauritius Tertiary Education Commission (TEC) for Quality assurance of the Comments training programs is being implemented. Action Description Partner with an international apex institution to understand the role of an apex body Source DLI# Responsibility Timing Timing Value Status Technical DLI 6 Client-CESB Due Date 31-Dec-2019 In Progress Completion Measurement A new Skills development strategy developed with defined skills governance structures. 10/11/2019 Page 3 of 11 The World Bank Implementation Status & Results Report Rwanda Priority Skills for Growth (PSG) (P252350) Tony Blair Institute (TBI) is providing support, including deployment of international staff to RDB and MINEDUC, for TA support in Comments strengthening overall skills governance. Action Description Development and operation of a student loan MIS Source DLI# Responsibility Timing Timing Value Status Technical DLI 6 Client-CESB Due Date 31-Dec-2019 Revised Date Completion Measurement Student loan MIS established and functional (MIS able to generate on demand reports for loans administration). The student loan MIS was established and is functional. MoU between BRD and Association of African Higher Education Financing Comments Agencies (AAHEFA)/ Kenya Higher Education Loans Board (HELB) for Management of student loans recovery is being implemented. Action Description Development of a M&E system to be undertaken considering multiple agencies Source DLI# Responsibility Timing Timing Value Status Technical DLI 6 Client CESB Due Date 31-Dec-2019 In Progress Completion Measurement Trainings completed. Training on Project Management, Change Management and Monitoring and Evaluation was conducted by Rwanda management Comments institute for WDA, RP, HEC, MINEDUC and RDB. A second round of training is planned to include BRD. Action Description Strengthen inspection and monitoring of tertiary institutions Source DLI# Responsibility Timing Timing Value Status Technical DLI 6 Client-CESB Recurrent Continuous In Progress Completion Measurement Milestones for quality assurance in the MoU between HEC and TEC fully implemented. This aspect is captured in the milestones for the MoU between Higher Education Council (HEC) and Mauritius Tertiary Education Comments Commission (TEC). Risks Systematic Operations Risk-rating Tool Risk Category Rating at Approval Previous Rating Current Rating Political and Governance ►Low ►Low ►Low 10/11/2019 Page 4 of 11 The World Bank Implementation Status & Results Report Rwanda Priority Skills for Growth (PSG) (P252350) Macroeconomic ►Low ►Low ►Low Sector Strategies and Policies ►Moderate ►Moderate ►Moderate Technical Design of Project or Program ►Substantial ►Substantial ►Substantial Institutional Capacity for Implementation and Sustainability ►Substantial ►Moderate ►Moderate Fiduciary ►Moderate ►Moderate ►Moderate Environment and Social ►Moderate ►Moderate ►Substantial Stakeholders ►Moderate ►Moderate ►Moderate Other -- -- -- Overall ►Substantial ►Substantial ►Substantial RiskComments Comments The safeguards issues mainly pertain to the operations of the SDF. The SDF grantees are at different levels of compliance regarding Occupational Health and Safety (OHS); the level of awareness of OHS is inadequate among the SDF grantees and this contributes to the non-compliance to OHS requirements for working environment; and WDA does not have a qualified OHS staff with the required skills/expertise. For this reason, the safeguards rating is being downgraded from satisfactory to moderately satisfactory and the E&S risk rating is revised from moderate to substantial. Results PDO Indicators by Objectives / Outcomes Ensure provision of quality training programs with market relevance IN00744433 ►New or updated programs accredited for occupations in at least one of the selected economic sectors (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 13.00 17.00 17.00 46.00 Date 05-Jul-2017 21-Mar-2019 04-Sep-2019 30-Sep-2020 This indicator is on track and will be updated in November 2019 after the planned verification process for new and updated programs. In total, 29 additional programs are needed to meet the end target. To meet this target, 30 additional programs are at various stages -development, accreditation and verification (12 TVET programs developed, accredited and awaiting Comments verification; 3 TVET programs developed and being accredited; 8 TVET programs being developed; and 7 degree programs developed and being accredited). Expanding opportunities for continuous upgrading of job relevant skills for sustained employability IN00744434 ►Percentage of SDF supported trainees employed/self-employed 6 months after graduation(% of female graduates:34) (Percentage, Custom) Baseline Actual (Previous) Actual (Current) End Target 10/11/2019 Page 5 of 11 The World Bank Implementation Status & Results Report Rwanda Priority Skills for Growth (PSG) (P252350) Value 0.00 0.00 0.00 64.00 Date 05-Jul-2017 21-Mar-2019 04-Sep-2019 30-Sep-2020 Tracer studies to inform this indicator will be conducted from January/February 2020 on wards-six months after graduation. The first cohort of the 4,592 SDF trainees graduated in June 2019; the second cohort of 2,395 is in session and is Comments expected to graduate in October 2019 and verified in November 2019; and relevant evaluations are ongoing for the third cohort. IN00744435 ►Improved sustainability of financing for long term training programs as measured by student loan recovery(percentage) (Percentage, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 16.00 19.00 23.00 27.00 Date 05-Jul-2017 21-Mar-2019 04-Sep-2019 30-Sep-2020 This indicator is on track. BRD has achieved an additional 4 percentage points to meet the 11 percentage points target. Comments Capacity building for implementation IN00744432 ►Capacity Building for targeted entities in five areas, each with progress milestones, is completed (Yes/No, Custom) Baseline Actual (Previous) Actual (Current) End Target Value No No No Yes Date 05-Jul-2017 21-Mar-2019 04-Sep-2019 30-Sep-2020 This indicator is on track. -DLR 6.1: Signing of MoU and agreement by CESB of capacity building plans, with specified milestones completed and verified. -DLR 6.2: Completion of milestones in three target areas of the five capacity building areas is progressing well. Completion of all milestones for one capacity building area (curriculum development) for RDB- Mott McDonald is being verified. Comments Completion of milestones for two additional capacity building area for BRD-AAHEFA (students loan administration); and HEC -TEC( quality assurance systems in higher education) is advanced and is planned for completed by December 2019. Intermediate Results Indicators by Results Areas Reinforce governance of the skills development system IN00744441 ►Strengthened Pillar 1 (skills development) of the NEP, as evidenced by the implementation of a JPC that integrates the results of the sector level action plans (Yes/No, Custom) Baseline Actual (Previous) Actual (Current) End Target Value No No Yes Yes 10/11/2019 Page 6 of 11 The World Bank Implementation Status & Results Report Rwanda Priority Skills for Growth (PSG) (P252350) Date 05-Jul-2017 21-Mar-2019 04-Sep-2019 30-Sep-2020 Key elements of the action plans were incorporated in NEP JPCs and are bring implemented. RDB -CSO is Comments monitoring implementation of the NEP JPCs for activities related to the target sector plans. IN00744445 ►Action plans for specialized technical and professional skills development are formulated for the selected economic (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 3.00 3.00 Date 05-Jul-2017 21-Mar-2019 04-Sep-2019 30-Sep-2020 Skills assessments and related action plans for the three target sectors Energy, Transport & Logistics (T&L) and Comments Manufacturing (agro-processing) were completed and verified. IN00744448 ►Key elements of the action plans are incorporated in NEP JPC (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 3.00 3.00 Date 05-Jul-2017 21-Mar-2019 04-Sep-2019 30-Sep-2020 Key elements of the action plans were incorporated in NEP JPC and verified. Comments IN00744450 ►Skills Development and Employment Promotion Strategy as a follow-on to the NEP is approved by Cabinet (Yes/No, Custom) Baseline Actual (Previous) Actual (Current) End Target Value No No Yes Yes Date 05-Jul-2017 21-Mar-2019 04-Sep-2019 30-Sep-2020 Skills Development and Employment Promotion Strategy (NSDES) as a follow-on to the NEP is approved by Cabinet. The Comments NSDES was developed and approved by the Cabinet in June 2019. Ensure provision of quality training programs with market relevance IN00744444 ►Number of accredited new or updated programs taught by staff participating in industry attachments in the selected economic sectors. (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 0.00 15.00 Date 05-Jul-2017 21-Mar-2019 04-Sep-2019 30-Sep-2020 This indicator is on track, and will be updated after verification. Industrial attachments for 20 staff teaching Energy programs (3 Bachelors / 1 TVET ) is nearing completion: attachment is completed for 12 TVET staff; attachment is ongoing for 6 UR Comments staff; and 2 UR staff have completed the attachment. The 20 staff are from one of the three target economic sectors, Energy. Industrial attachments for faculty teaching new / updated Transport and Logistics and Manufacturing programs is planned to begin in October 2019. 10/11/2019 Page 7 of 11 The World Bank Implementation Status & Results Report Rwanda Priority Skills for Growth (PSG) (P252350) IN00744447 ►Percentage of new or updated programs with a modularized design aligned with the REQF in the selected economic sectors (Percentage, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 16.00 50.00 Date 05-Jul-2017 21-Mar-2019 04-Sep-2019 30-Sep-2020 UR and RP are developing programs aligned with the REQF, including the new and updated programs being developed under the Program. This indicator will be updated after verification-to confirm programs with a modularized design Comments aligned with the REQF, which are mainly TVET. Expanding opportunities for continuous upgrading of job relevant skills for sustained employability IN00744442 ►Number of graduates of SDF supported programs by window (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 4,592.00 9,000.00 Date 05-Jul-2017 21-Mar-2019 04-Sep-2019 30-Sep-2020 This indicator is on track. The first cohort of the 4,592 SDF trainees graduated in June 2019; the second cohort of 2,395 is in session and is expected to graduate in October 2019 and verified in November 2019; and relevant evaluations are ongoing Comments for the third cohort. IN00744446 ►BRD Loan Recovery Management Information System is operational (Yes/No, Custom) Baseline Actual (Previous) Actual (Current) End Target Value No No Yes Yes Date 05-Jul-2017 21-Mar-2019 04-Sep-2019 30-Sep-2020 The students loan recovery management information system (MIS) is now operational and was verified. The seven modules are functional and can generate on demand students loans disbursement and loan recovery reports. Comments IN00744449 ►Number of loan recipients from the 1980 – 2015 cohort who are repaying loans that are registered in the loan recovery MIS (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 10,000.00 17,197.00 19,171.00 25,000.00 Date 05-Jul-2017 21-Mar-2019 04-Sep-2019 30-Sep-2020 Includes students confirmed having studied from 1980-2015, are paying the loan and are recorded in the system. The 19, 171 Comments is the baseline of 10,000 plus 9,161 beneficiaries. IN00744451 10/11/2019 Page 8 of 11 The World Bank Implementation Status & Results Report Rwanda Priority Skills for Growth (PSG) (P252350) ►Number of students receiving loans for long-term training (% female, % STEM) (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 7,607.00 8,668.00 8,690.00 9,370.00 Date 05-Jul-2017 21-Mar-2019 04-Sep-2019 30-Sep-2020 STEM: 7,714 (89%) Female 2,561 (30%) NON-STEM: 976 (11%) Comments Capacity building for implementation IN00744443 ►Capacity building for targeted entities in five areas, each with progress milestones, is completed (Yes/No, Custom) Baseline Actual (Previous) Actual (Current) End Target Value No No No Yes Date 05-Jul-2017 21-Mar-2019 04-Sep-2019 30-Sep-2020 This indicator is on track. Completion of milestones in three target areas of the five capacity building areas is progressing well. Completion of all milestones for one capacity building area (curriculum development) for RDB- Mott McDonald is being verified. Completion of milestones for two additional capacity building area for BRD-AAHEFA (students loan Comments administration); and HEC -TEC( quality assurance systems in higher education) is advanced and is planned for completed by December 2019. Disbursement Linked Indicators DLI_IND_TABLE ►DLI 1 Strengthened Pillar 1 (skills development) of the NEP, as evidenced by the implementation of a JPC that integrates the results of the sector level action plans (Intermediate Outcome, 25.00, 101%) Baseline Actual (Previous) Actual (Current) March 2020 Value No No Yes Yes Date 05-Jul-2017 21-Mar-2019 04-Sep-2019 -- • DLR 1.1: Action plans for specialised technical and professional skills development are formulated for the selected economic sectors. Skills assessments and the associated action plans for Transport & Logistics (T&L), Energy and Manufacturing (agro-processing) sectors were completed and verified. • DLR 1.2: Key elements of the action plans incorporated in NEP JPC Skills assessments and associated action plans Comments for Transport & Logistics (T&L), Energy and Manufacturing (agro-processing) sectors were completed. Key elements of the action plans were incorporated in NEP JPC and verified. • DLR 1.3: Skills Development and Employment Promotion Strategy (NSDES) as a follow-on to the NEP is approved by Cabinet. The NSDES was developed and approved by the Cabinet in June 2019 and verified. ►DLI 2 New or updated programs accredited for occupations in at least one of the selected economic sectors (Intermediate Outcome, 30.50, 14%) 10/11/2019 Page 9 of 11 The World Bank Implementation Status & Results Report Rwanda Priority Skills for Growth (PSG) (P252350) Baseline Actual (Previous) Actual (Current) March 2020 Value 13.00 17.00 17.00 3.00 Date -- 21-Mar-2019 04-Sep-2019 -- This indicator is on track and will be updated in November 2019 after the planned verification process for new and updated programs. In total, 29 additional programs are needed to meet the end target. To meet this target, 30 additional programs are at various stages -development, accreditation and verification (12 TVET programs developed, accredited and awaiting verification; Comments 3 TVET programs developed and being accredited; 8 TVET programs being developed; and 7 degree programs developed and being accredited). ►DLI 3 Number of accredited new or updated programs taught by staff participating in industry attachments in the selected economic sectors (Intermediate Outcome, 5.00, 0%) Baseline Actual (Previous) Actual (Current) March 2020 Value 0.00 13.00 0.00 -- Date 05-Jul-2017 21-Mar-2019 04-Sep-2019 -- This indicator is on track, and will be updated after verification. Industrial attachments for 20 staff teaching Energy programs (3 Bachelors / 1 TVET ) is nearing completion: attachment is completed for 12 TVET staff; attachment is ongoing for 6 UR staff; and 2 UR staff have completed the attachment. The 20 staff are from one of the three target economic sectors, Energy. Comments Industrial attachments for faculty teaching new / updated Transport and Logistics and Manufacturing programs is planned to begin in October 2019. ►DLI 4 Number of graduates of Skills Development Fund (SDF) supported programs by window (Intermediate Outcome, 24.50, 59%) Baseline Actual (Previous) Actual (Current) March 2020 Value 0.00 0.00 4,592.00 -- Date 05-Jul-2017 21-Mar-2019 04-Sep-2019 -- The first cohort of the 4,592 SDF trainees graduated in June 2019; the second cohort of 2,395 is in session and is expected to Comments graduate in October 2019 and verified in November 2019; and relevant evaluations are ongoing for the third cohort. ►DLI 5 Improved sustainability of financing for long term training programs as measured by student loan recovery (Intermediate Outcome, 25.00, 69%) Baseline Actual (Previous) Actual (Current) March 2020 Value 16.00 17.00 23.00 11.00 Date 05-Jul-2017 21-Mar-2019 04-Sep-2019 -- This indicator is on track. BRD has achieved an additional 4 percentage points to meet the 11 percentage points target. Comments 10/11/2019 Page 10 of 11 The World Bank Implementation Status & Results Report Rwanda Priority Skills for Growth (PSG) (P252350) ►DLI 6 Capacity building for targeted entities in five areas, each with progress milestones, is completed (Intermediate Outcome, 10.00, 51%) Baseline Actual (Previous) Actual (Current) March 2020 Value No No No -- Date 05-Jul-2017 21-Mar-2019 04-Sep-2019 -- This indicator is on track. -DLR 6.1: Signing of MoU and agreement by CESB of capacity building plans, with specified milestones completed and verified. -DLR 6.2: Completion of milestones in three target areas of the five capacity building areas is progressing well. Completion of all Comments milestones for one capacity building area (curriculum development) for RDB- Mott McDonald is being verified. Completion of milestones for two additional capacity building area for BRD-AAHEFA (students loan administration); and HEC -TEC( quality assurance systems in higher education) is advanced and is planned for completed by December 2019. 10/11/2019 Page 11 of 11