The World Bank Implementation Status & Results Report Ghana Secondary Education Improvement Project (P145741) Ghana Secondary Education Improvement Project (P145741) AFRICA | Ghana | Education Global Practice | IBRD/IDA | Investment Project Financing | FY 2014 | Seq No: 9 | ARCHIVED on 27-Dec-2018 | ISR35091 | Implementing Agencies: Ministry of Education, Ministry of Finance, Ministry of Education, Ministry of Finance, Ministry of Finance, Ghana Education Service Key Dates Key Project Dates Bank Approval Date: 20-May-2014 Effectiveness Date: 03-Oct-2014 Planned Mid Term Review Date: 26-Jan-2018 Actual Mid-Term Review Date: 26-Jan-2018 Original Closing Date: 30-Nov-2019 Revised Closing Date: 30-Nov-2021 pdoTable Project Development Objectives Project Development Objective (from Project Appraisal Document) The Project Development Objective is to increase access to senior secondary education in underserved districts and improve quality in low- performing senior high schools in Ghana. Has the Project Development Objective been changed since Board Approval of the Project Objective? No Components Table Name Support to Increase Access with Equity and Quality in Senior High Schools:(Cost $177.10 M) Management, Research and Monitoring and Evaluation:(Cost $18.90 M) Overall Ratings Name Previous Rating Current Rating Progress towards achievement of PDO Satisfactory Satisfactory Overall Implementation Progress (IP) Moderately Satisfactory Satisfactory Overall Risk Rating Substantial Substantial Implementation Status and Key Decisions This implementation status and results report (ISR) is based on the implementation support mission carried out from July 23-27, 2018 and subsequent discussions held through audio and video conferencing and the recent education missions from October 23-November 5, 2018; and December 10-14, 2018. Main messages:  Important progress has been observed under the project. The Bank is pleased to note the overall progress of the project with 90 percent of the original project financing disbursed. Substantial progress has been made against all key performance indicators. The Junior High School (JHS) to Senior High School (SHS) transition rate demonstrated significant improvement increasing from 39 percent in 2014 12/27/2018 Page 1 of 10 The World Bank Implementation Status & Results Report Ghana Secondary Education Improvement Project (P145741) to 51 percent in 2017 and to 64 percent in 2018. The PDO-level indicator looking at the quality of the low-performing SHS in Ghana as measured by the most recent West African Secondary School Certificate Exam (WASSCE) indicates an increase in the percentage of students meeting tertiary requirements from 10.7 percent in 2014 to 15.2 percent in 2018. In addition, calculating a mid-line assessment using the Ghana Living Standard Survey (GLSS)7 results, the educational attainment within the two poorest quintiles of targeted districts has increased from a baseline of 14.3 percent in 2014 to 22.4 percent in 2016/17. With respect to intermediate outcomes, the SEIP has measured an improvement in completion rates (81.7 percent in 2014/15 to 84.1 percent in 2017/18), more than 10,000 scholarships disbursed, and School Performance Partnership Plans (SPPPs) signed in all 125 original beneficiary schools and 106 additional financing schools (231 total).  Key achievements under the results-based component have included the rehabilitation of 50 existing SHS, the provision of over 10,000 scholarships to students from low income families (of which 60.5 percent are girls), establishment and roll out of a school mapping portal, development of School Performance Partnership Plans (SPPPs) for 231 schools with commensurate funding released to 125 project schools and the introduction of an ICT based mechanism (i-box and I-campus) to deliver supplementary classroom materials. However, the new construction of 23 SHS has stagnated, with only 16 SHS operationalized as of September 2018. While classroom blocks (E-blocks) have been completed for all 16, only 13 have the full complement of infrastructure lacking construction of lot B infrastructure (canteen, teacher housing, etc.) which is significantly behind schedule. The remaining 7 schools will need to be completed in time to begin enrolling students in 2019. In addition, the planned (5) vocational and technical blocks have yet to be initiated. The science and math teacher training is now back on track. Leadership training for school heads was conducted in August 2018 The School Mapping Platform also suffered setbacks from delays in training school ICT officers and school heads on how to update their school data on line. Slow contracting procedures have led to delays.  As of this ISR, Government has achieved and verified five out of the six Year 3 Disbursement Linked Results (DLRs) and is well underway to achieving the Year 4 DLRs for the original credit. The unmet DLR for Year 3 is the publication of updated school performance data for FY16/17 which will be verified by the end of December 2018. The school mapping brochures have been printed and distribution is underway. The Bank and Government are considering a restructuring for this DLR to measure publication of the school mapping portal online only. The World Bank is also concerned about the utilization of the iBox in project schools. Therefore, the DLR for ICT roll out would encourage greater focus on the use of the I-campus portal as well to ensure content is being shared with students and teachers.  The additional financing (AF) for the SEIP was approved by the World Bank’s Board of Executive Directors on June 27, 2017, signed on January 8, 2018 and became effective on April 9, 2018 after completing the revision of the Project Implementation Manual (PIM). The AF provides a US$40 million credit to cover the costs associated with scaled-up activities to enhance project coverage to additional (106) low- performing schools in the SEIP-targeted districts with the aim of further increasing equitable access to and improving the quality of teaching and learning at the secondary level. Funds also cover the incremental management costs and technical assistance activities associated with the expansion of activities under the AF and the extension of the closing date of the SEIP from November 30, 2019 to November 30, 2021. The AF supports five out of the seven results to increase coverage of these targets and reward additional results for 2019 and 2020. Component 1, Pillar 1 Increasing access with equity:  New construction is still ongoing and only 13 schools have been reported as fully completed by September 2018, although 16 SHS have been operationalized (are enrolling students). Final accounts are yet to be settled for any of the completed construction works and there are extensive cost overruns on the gross contract value of 9.70 percent.  For the rehabilitation and expansion in 50 existing low performing schools, all have been completed with facilities in use, of which 33 final accounts have been settled. With regard to scholarships for students from low income families, the current cumulative number of students benefitting from scholarships totals 10,025. Component 1, Pillar 2 Improve the quality of education in selected low-performing Senior High Schools:  In 2017, the SPPPs process was revamped to include self-study reports from schools (needs assessment with performance data), key performance indicators (KPIs) tracking both past performance and targets set by the schools, and the selection of activities by SEIP schools from a pre-determined and coded menu of eligible activities. The menu of activities was coded according to four objectives: access, school health, quality, and school management and these were also separated into non-procurement and procurement activities. All of the 231 SEIP beneficiary schools have submitted School Performance Partnerships Plans (SPPPs). Funds have been disbursed against the original credit 125 schools. These plans aim to support school- level interventions to improve quality of SHS teaching and learning. In addition, replicating the SEIP process, the MOE has also signed performance contracts with almost all non-SEIP SHS. The MOE took up the MTR recommendation to conduct an internal audit on SPPPs, and the report has been finalized. Further sensitization will be needed to ensure strengthened understanding of the plans and implementation processes.  Initial training in science and math teaching methods was rolled out to over 1,000 teachers in 2015-2016. The next training for teachers was held in February 2018 when 241 core Mathematics and 243 Science teachers were trained.  Electronic content has been developed for the iBox-i-campus system (teaching and learning portal) with modules in core subjects for SHS1 and SHS2 grades completed to date and the iCampus was rolled out in July 2018. The i-boxes deliver pre-prepared video lessons, student exercises and content assessment to SHS students and teachers. The i-boxes have been rolled out to all 125 schools. Reports from the Mid-Term Review indicate that usage of the iBox is low both in terms of time and frequency. Component 2: Management, Research, Monitoring and Evaluation  Government has hired Independent Verification firms to validate and verify project results. 12/27/2018 Page 2 of 10 The World Bank Implementation Status & Results Report Ghana Secondary Education Improvement Project (P145741)  An impact evaluation is ongoing and a midline survey is currently being rolled out to assess the impact of the i-Box on beneficiary SHS and assess the extent to which follow-up science and mathematics teacher training has an impact on student learning. Data from this survey will serve as a baseline for the implementation of the Math and Science for Sub-Saharan Africa (MS4SSA) program that Ghana will be piloting in 25 schools. Due to delays in procurement processes, decision-making and release of funds, the survey firm was delayed in going out to the field to collect relevant data and the field survey was just completed. The report has yet to be finalized.  Funds have also been utilized for Science and Math training, SPPP trainings, research activities (in-house Research Fellow, education evidence summit, etc.), school mapping activities, and various project management elements.  The research team has set up a research database and organizes annual Education Research Evidence Summits (March 28-29, 2017 and August 6, 2018). Several reports were prepared as part of the Mid-Term Review.  Electronic content has been developed for the i-campus system (teaching and learning portal through i-box technology) with 200 modules in four core subjects (English, Mathematics, Integrated Science and Social Studies) completed for SHS1 and SHS2 with work under way on SHS3 content. An Information Communication Technology (ICT) firm has been contracted to expand the functionality of the school mapping portal to include monitoring of school subsidies, scholarships, SPPPs and other key data. Results for Year Three (verified in September 2018): The disbursement-linked results for year 3 include the following: (a) About 5,000 new seats created in underserved districts(achieved and verified); (b) Increase in enrollment in low performing schools by about 3,000 seats (achieved and verified); (c) at least 6,000 SHS students receiving scholarships in project schools (10,025 achieved and verified); (d) Publication of updated school performance data for academic year 16/17 online and in brochure (not yet achieved); (e) SPPPs for at least 100 schools signed (125 achieved and verified); and (f) ICT-based instruction rolled out in at least 95% of beneficiary schools (achieved and verified). Risks Systematic Operations Risk-rating Tool Risk Category Rating at Approval Previous Rating Current Rating Political and Governance -- Substantial Substantial Macroeconomic -- Substantial Substantial Sector Strategies and Policies -- Substantial Substantial Technical Design of Project or Program -- Moderate Moderate Institutional Capacity for Implementation and Sustainability -- Substantial Substantial Fiduciary -- Moderate Moderate Environment and Social -- Substantial Substantial Stakeholders -- Moderate Moderate Other -- -- -- Overall -- Substantial Substantial Results PDO Indicators by Objectives / Outcomes Increase access in senior secondary education in underserved districts IN00612158 ►Increase in Transition Rates from JHS3 to SHS1 in targeted districts (Percentage, Custom) 12/27/2018 Page 3 of 10 The World Bank Implementation Status & Results Report Ghana Secondary Education Improvement Project (P145741) Baseline Actual (Previous) Actual (Current) End Target Value 39.00 51.00 64.00 66.00 Date 01-Oct-2014 21-Dec-2017 10-Dec-2018 01-Nov-2021 Increase equitable access to senior secondary education in underserved districts IN00612213 ►Increase in SHS education attainment within the two poorest quintiles in targeted districts (disaggregated by gender) (Percentage, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 8.40 -- 0.00 15.00 Date 01-Oct-2014 -- 10-Dec-2018 01-Nov-2021 This indicator will be measured by an endline survey, although with project extension and additional financing, an analysis has been conducted using the latest Ghana Living Standards Survey to measure changes between 2013 GLSS6 and 2017 GLSS7 using consumption index for two poorest quintiles (as opposed to the wealth quintiles used with the Population and Housing Census -PHC-2010). In addition, this analysis includes all beneficiary districts under the SEIP whereas the current baseline for this indicator Comments: only measured the districts where expansion was planned. Now that the AF is supporting the 75 schools for rehabilitation/expansion of classrooms, all districts under the SEIP will be captured. This would necessitate the baseline indicator to be updated. It was agreed that the endline data would be collected using the PHC 2020. IN00612159 ►Increase in SHS educational attainment within the two poorest quintiles in targeted districts (male) (Percentage, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 11.10 -- 0.00 18.90 Date 01-Oct-2014 -- 10-Dec-2018 01-Nov-2021 This indicator will be measured by an endline survey, although with project extension and additional financing, an analysis may be conducted using the latest Ghana Living Standards Survey (results Comments: expected July/August 2018). IN00612214 Increase in SHS educational attainment within the two poorest quintiles in targeted districts (female) (Percentage, Custom Breakdown) Baseline Actual (Previous) Actual (Current) End Target Value 6.10 -- 0.00 11.70 Date 01-Oct-2014 -- 10-Dec-2018 01-Nov-2021 IN00612210 ►Direct project beneficiaries (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 230,000.00 307,982.00 711,000.00 Date 01-Oct-2014 21-Dec-2017 10-Dec-2018 01-Nov-2021 This figure is for the original 125 SEIP schools. An additional indicator is being tracked to include the AF Comments: SEIP schools (which includes the 23 newly constructed schools). 12/27/2018 Page 4 of 10 The World Bank Implementation Status & Results Report Ghana Secondary Education Improvement Project (P145741) IN00612218 Female beneficiaries (Percentage, Custom Supplement) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 45.80 46.00 44.10 IN00655669 ►Direct project beneficiaries (students, teachers, non-teaching staff) AF (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 -- 160,628.00 250,000.00 Date 30-Jan-2017 -- 10-Dec-2018 01-Nov-2021 IN00655670 Female Beneficiaries (Percentage, Custom Supplement) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 -- 46.90 50.00 Improve quality in low-performing senior high schools in Ghana IN00612160 ►Increase in WASSCE achievement of percentage of students obtaining 6 credits and above within beneficiary schools (disaggregated by gender) (Percentage, Custom, DLI) Baseline Actual (Previous) Actual (Current) End Target Value 10.70 12.20 15.20 16.80 Date 01-Oct-2014 31-Oct-2017 30-Nov-2018 01-Nov-2021 Note: Male percentage was 13.5% in 2017. This indicator will be updated when WASSCE 2018 data Comments: is processed in September 2018. IN00612215 Increase in WASSCE achievement of percentage of students obtaining 6 credits and above within beneficiary schools (female) (Percentage, Custom Breakdown) Baseline Actual (Previous) Actual (Current) End Target Value 9.50 10.70 14.30 16.00 Date 26-Jan-2015 31-Oct-2017 30-Nov-2018 01-Nov-2021 Intermediate Results Indicators by Components Support to Increase Access with Equity and Quality in Senior High Schools IN00612201 ►New (additional) SHS seats created and utilized by SHS students in targeted schools (cumulative) (Number, Custom, DLI) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 8,966.00 8,966.00 15,000.00 Date 01-Oct-2014 01-Jun-2018 01-Jun-2018 01-Nov-2021 12/27/2018 Page 5 of 10 The World Bank Implementation Status & Results Report Ghana Secondary Education Improvement Project (P145741) This figure was verified by the independent verification firm in May/June 2018. Comments: IN00612202 ►Increase in seats created and utilized within low-performing beneficiary SHSs (cumulative) (Number, Custom, DLI) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 27,735.00 27,735.00 30,000.00 Date 01-Oct-2014 01-Jun-2018 01-Jun-2018 01-Nov-2021 This indicator was verified by the Independent Verification Firm in May/June 2018. The MOE will update Comments: end targets for this indicator owing to it already having been met in December 2017. IN00612209 ►Scholarships/bursaries are distributed to low-income students in participating districts and schools (cumulative) (Number, Custom, DLI) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 10,025.00 10,025.00 20,000.00 Date 01-Oct-2014 21-Dec-2017 10-Dec-2018 01-Nov-2021 This figure was verified by the independent verification firm. Note that the original project documents required 10,000 scholarship beneficiaries and additional financing added another 10,000 bursaries. The Comments: disbursement of bursaries under additional financing has not begun as yet. IN00612203 ►Teachers participating in training to upgrade or acquire new skills in mathematics (cumulative) (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 591.00 944.00 730.00 Date 01-Oct-2014 01-Jun-2018 30-Nov-2018 01-Nov-2021 241 core Mathematics teachers were trained in February 2018. 243 Science teachers were trained in February 2018. Currently, these teachers trained in the latest round were added to teachers trained in previous rounds; Comments: however, the MOE wants to avoid double counting (i.e. if the same teacher was trained twice) so has reconciled the teachers who were trained in the last training in February 2018 with previous rounds of training. IN00612216 Teachers participating in training to upgrade or acquire new skills in Science (cumulative) (Number, Custom Breakdown) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 943.00 1,437.00 1,470.00 Date 01-Oct-2014 01-Jun-2018 30-Nov-2018 01-Nov-2019 IN00612204 ►Increase in completion rates in targeted schools (disaggregated by gender) (Percentage, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 81.70 84.10 84.10 86.71 Date 01-Dec-2015 21-Dec-2017 30-Nov-2018 01-Nov-2021 Comments: Note male completion rate was 83.4. This indicator will be updated once new data is collected from schools. 12/27/2018 Page 6 of 10 The World Bank Implementation Status & Results Report Ghana Secondary Education Improvement Project (P145741) IN00612217 Increase in completion rates in targeted schools disaggregated by gender (female) (Percentage, Custom Breakdown) Baseline Actual (Previous) Actual (Current) End Target Value 81.20 83.90 84.80 86.10 Date 01-Dec-2015 21-Dec-2017 30-Nov-2018 01-Nov-2021 IN00612205 ►Number of Performance Partnerships for Learning with beneficiary SHSs established (cumulative) (Number, Custom, DLI) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 125.00 231.00 231.00 Date 01-Oct-2014 01-Jun-2018 30-Nov-2018 01-Nov-2021 Note that while all 231 SEIP schools (original and AF) have reported signing SPPPs, only the original 125 Comments: schools are receiving funds at present. IN00612206 ►SHS ICT packages implemented in beneficiary schools (cumulative) (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 118.00 125.00 231.00 Date 01-Oct-2014 01-Jun-2018 30-Nov-2018 01-Nov-2019 Management, Research and Monitoring and Evaluation IN00612207 ►Monitoring system established and functioning to annually track data and publish information on all SHS schools in Ghana. (Yes/No, Custom) Baseline Actual (Previous) Actual (Current) End Target Value No Yes Yes Yes Date 01-Oct-2014 01-Jun-2018 30-Nov-2018 01-Nov-2021 IN00612208 ►Research and sector analyses conducted to inform elaboration of Secondary Education Strategy (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 2.00 7.00 7.00 Date 01-Oct-2014 21-Dec-2017 30-Nov-2018 01-Nov-2021 IN00612212 ►Students benefiting from direct interventions to enhance learning (Number, Corporate) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 -- 456,421.00 707,000.00 Date 09-Sep-2017 -- 30-Nov-2018 30-Nov-2021 IN00612219 12/27/2018 Page 7 of 10 The World Bank Implementation Status & Results Report Ghana Secondary Education Improvement Project (P145741) Students benefiting from direct interventions to enhance learning - Female (Number, Corporate Supplement) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 -- 214,901.00 341,000.00 IN00612211 ►Survey on beneficiary satisfaction (Yes/No, Custom) Baseline Actual (Previous) Actual (Current) End Target Value No -- Yes Yes Date 31-May-2017 -- 28-Dec-2017 30-Nov-2021 A beneficiary survey was conducted in December 2017 to inform the analyses for the Mid-Term Review. Comments: Disbursement Linked Indicators IN00657769 ►DLI 1 Targeting of school expansion in underserved school districts (Text, Process, 5,540,000.00, 100.00%) Baseline Actual (Previous) Actual (Current) 2018/2019- Year 4 Agreed targeting criteria Value 0.00 -- -- applied Date -- -- 20-Feb-2015 -- IN00657770 ►DLI 2 Increase in new seats for SHS students in underserved school districts (Number, Outcome, 23,200,000.00, 80.00%) Baseline Actual (Previous) Actual (Current) 2018/2019- Year 4 Value 0.00 -- 8,966.00 15,000.00 Date -- -- 10-Dec-2018 -- IN00657806 ►DLI 3 Increase in number of seats utilized in existing low-performing schools (Number, Outcome, 23,200,000.00, 80.00%) Baseline Actual (Previous) Actual (Current) 2018/2019- Year 4 Value 0.00 -- 27,735.00 5,000.00 Date -- -- 10-Dec-2018 -- IN00657807 ►DLI 4 Increased enrolment in SHS in targeted districts and schools for students from low-income families, especially girls (Number, Outcome, 23,220,000.00, 79.93%) Baseline Actual (Previous) Actual (Current) 2018/2019- Year 4 Value 0.00 -- 10,025.00 10,000.00 Date -- -- 10-Dec-2018 -- IN00657808 12/27/2018 Page 8 of 10 The World Bank Implementation Status & Results Report Ghana Secondary Education Improvement Project (P145741) ►DLI 5 Annual publication of school performance report (Text, Process, 18,560,000.00, 75.00%) Baseline Actual (Previous) Actual (Current) 2018/2019- Year 4 15/16 publication of Value 0.00 -- performance on line and in 17/18 publica brochure Date -- -- 11-Dec-2017 -- IN00657809 ►DLI 6 School Performance Partnerships in Beneficiary Schools (Number, Process, 23,200,000.00, 80.00%) Baseline Actual (Previous) Actual (Current) 2018/2019- Year 4 Value 0.00 -- 231.00 125.00 Date -- -- 10-Dec-2018 -- IN00657810 ►DLI 7 Improved learning outcomes in beneficiary SHS (Percentage, Outcome, 23,200,000.00, 80.00%) Baseline Actual (Previous) Actual (Current) 2018/2019- Year 4 Value 14.20 -- 15.20 -- Date -- -- 10-Dec-2018 -- Data on Financial Performance Disbursements (by loan) Project Loan/Credit/TF Status Currency Original Revised Cancelled Disbursed Undisbursed % Disbursed P145741 IDA-54520 Effective USD 156.00 156.00 0.00 126.97 13.59 90% P145741 IDA-61220 Effective USD 40.00 40.00 0.00 0.00 41.39 0% Key Dates (by loan) Project Loan/Credit/TF Status Approval Date Signing Date Effectiveness Date Orig. Closing Date Rev. Closing Date P145741 IDA-54520 Effective 20-May-2014 31-Jul-2014 03-Oct-2014 30-Nov-2019 30-Nov-2019 P145741 IDA-61220 Effective 28-Jun-2017 08-Jan-2018 09-Apr-2018 30-Nov-2021 30-Nov-2021 Cumulative Disbursements 12/27/2018 Page 9 of 10 The World Bank Implementation Status & Results Report Ghana Secondary Education Improvement Project (P145741) Restructuring History Level 2 Approved on 26-Aug-2016 Related Project(s) P163628-Secondary Education Improvement Project Additional Financing 12/27/2018 Page 10 of 10