The World Bank Implementation Status & Results Report Pakistan: Third Punjab Education Sector Project (P154524) Pakistan: Third Punjab Education Sector Project (P154524) SOUTH ASIA | Pakistan | Education Global Practice | IBRD/IDA | Investment Project Financing | FY 2016 | Seq No: 5 | ARCHIVED on 20-Jan-2019 | ISR35550 | Implementing Agencies: Islamic Republic of Pakistan, School Education Department Key Dates Key Project Dates Bank Approval Date: 03-Jun-2016 Effectiveness Date: 05-Oct-2016 Planned Mid Term Review Date: -- Actual Mid-Term Review Date: -- Original Closing Date: 31-Dec-2021 Revised Closing Date: 31-Dec-2021 pdoTable Project Development Objectives Project Development Objective (from Project Appraisal Document) The project development objective is to support Punjab province to improve school participation, completion, and teaching-learning practices with a particular focus on low-performing districts. Has the Project Development Objective been changed since Board Approval of the Project Objective? No Components Table Name Component 1: Improved access, quality and education system management:(Cost $290.00 M) Component 2: Capacity Building, Project Management, Monitoring, and Evaluation:(Cost $10.00 M) Overall Ratings Name Previous Rating Current Rating Progress towards achievement of PDO Moderately Satisfactory Moderately Satisfactory Overall Implementation Progress (IP) Moderately Satisfactory Moderately Satisfactory Overall Risk Rating Moderate Moderate Implementation Status and Key Decisions The Third Punjab Education Sector Project has completed two years of implementation and has disbursed almost 39% of the funds. The project supports the implementation of the Government of Punjab’s larger education program supporting the 2018 Education Goals. The project has already witnessed an increase in primary school completion rates, and satisfactory progress is seen in at least seven of the nine Disbursement Linked Indicators. The first round of data collection for the Service Delivery Indicator (SDI) Survey has been completed, and initial results have been discussed with the key counterparts. This survey is providing insight into education service delivery in the province, specifically, student learning, teacher competencies, teaching and learning practices in the classroom and school management practices. The survey to assess the level of school readiness of children is almost complete. Both these surveys will provide baseline for the two key Project Development Objective indicators on school readiness and quality score of teaching and learning at the classroom level. 1/20/2019 Page 1 of 12 The World Bank Implementation Status & Results Report Pakistan: Third Punjab Education Sector Project (P154524) The restructuring of the project for aligning the DLI on teacher Continuous Professional Development is underway to reflect the new structure under Quaid-e-Azam Academy for Educational Development as opposed to the structure under Directorate of Staff Development at the time of project preparation. Risks Systematic Operations Risk-rating Tool 1/20/2019 Page 2 of 12 The World Bank Implementation Status & Results Report Pakistan: Third Punjab Education Sector Project (P154524) Risk Category Rating at Approval Previous Rating Current Rating Political and Governance Substantial Substantial Substantial Macroeconomic Substantial Substantial Substantial Sector Strategies and Policies Moderate Moderate Moderate Technical Design of Project or Program Moderate Moderate Moderate Institutional Capacity for Implementation and Sustainability Moderate Moderate Moderate Fiduciary Moderate Moderate Moderate Environment and Social Low Moderate Moderate Stakeholders Moderate Moderate Moderate Other Substantial Substantial Substantial Overall Moderate Moderate Moderate Results PDO Indicators by Objectives / Outcomes To improve school participation IN00606689 ►Participation Rate (Percentage, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 75.80 75.80 75.80 79.00 Date 30-Jun-2014 30-Jun-2014 30-Jun-2014 30-Jun-2021 Measures the number of children in the relevant age group who are enrolled in school (regardless of Comments: grade), expressed as a percentage of the number of children in the relevant age group. IN00606758 Participation rate, boys (6-10 years) (Percentage, Custom Breakdown) Baseline Actual (Previous) Actual (Current) End Target Value 85.40 85.40 85.40 87.00 Date 30-Jun-2014 30-Jun-2014 30-Jun-2014 30-Jun-2021 IN00606759 Participation rate, girls (6-10 years) (Percentage, Custom Breakdown) Baseline Actual (Previous) Actual (Current) End Target Value 77.80 77.80 77.80 80.00 Date 30-Jun-2014 30-Jun-2014 30-Jun-2014 30-Jun-2021 IN00606760 Participation rate, boys (11-15 years) (Percentage, Custom Breakdown) 1/20/2019 Page 3 of 12 The World Bank Implementation Status & Results Report Pakistan: Third Punjab Education Sector Project (P154524) Baseline Actual (Previous) Actual (Current) End Target Value 75.40 75.40 75.40 79.00 Date 30-Jun-2014 30-Jun-2014 30-Jun-2014 30-Jun-2021 IN00606761 Participation rate, girls (11-15 years) (Percentage, Custom Breakdown) Baseline Actual (Previous) Actual (Current) End Target Value 64.60 64.60 64.60 68.00 Date 30-Jun-2014 30-Jun-2014 30-Jun-2014 30-Jun-2021 IN00606762 Participation rate, poor-performing districts (Percentage, Custom Breakdown) Baseline Actual (Previous) Actual (Current) End Target Value 68.50 68.50 68.50 73.00 Date 30-Jun-2013 30-Jun-2014 30-Jun-2014 30-Jun-2021 To improve school completion IN00663326 ►Completion rate, grade 5 (Percentage, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 67.00 -- 71.80 70.00 Date 30-Jun-2014 -- 04-Jun-2018 30-Jun-2021 IN00663298 Completion rate, grade 5, girls (Percentage, Custom Breakdown) Baseline Actual (Previous) Actual (Current) End Target Value 66.00 -- 73.35 69.00 Date 30-Jun-2014 -- 04-Jun-2018 30-Jun-2021 IN00663299 Completion rate, Grade 5, boys (Percentage, Custom Breakdown) Baseline Actual (Previous) Actual (Current) End Target Value 69.00 -- 70.37 71.00 Date 30-Jun-2014 -- 04-Jun-2018 30-Jun-2021 To improve teaching-learning practices IN00606752 ►Quality score of primary teaching-learning practices (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 2.53 -- 2.53 2.65 1/20/2019 Page 4 of 12 The World Bank Implementation Status & Results Report Pakistan: Third Punjab Education Sector Project (P154524) Date 05-Mar-2018 14-Nov-2018 05-Mar-2018 30-Jun-2021 A score constructed from the teaching-learning practices performance of primary-grade teachers. The performance is scored using an observation format that covers different dimensions of the teaching- Comments: learning process, e.g. the use of and adherence to a lesson plan, interaction with students, classroom management, assigning and checking written work. IN00606755 ►Level of School Readiness (Text, Custom) Baseline Actual (Previous) Actual (Current) End Target Value TBD TBD TBD TBD Date 04-Jun-2018 14-Nov-2018 14-Nov-2018 01-Dec-2021 Measures the child's readiness for primary school. The level is a score derived from the child's Comments: performance on a pre-school readiness measurement tool that assesses pre-literacy, pre-numeracy and fine motor skills, as well as the child's level language and socio-emotional development. Intermediate Results Indicators by Components Component 1: Improved access, quality and education system management IN00606757 ►Number of districts in which at least 70% of primary public schools are covered by strengthened package of field-based CPD (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 0.00 6.00 Date 01-Jan-2016 14-Nov-2018 14-Nov-2018 30-Jun-2021 Measures the number of districts in which at least 85% of primary public schools receive all elements of Comments: the strengthened package as outlined in DLI 6. IN00606756 ►Number of School Council members reached through citizen engagement initiative(s) (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 80,000.00 80,000.00 80,000.00 212,000.00 Date 04-Feb-2016 14-Nov-2018 14-Nov-2018 30-Jun-2021 Comments: Number of School Council members reached through citizen engagement initiative(s) IN00606754 ►Grades 5 and 8 PEC (revised) results are analyzed and widely disseminated in actionable form (Text, Custom) Baseline Actual (Previous) Actual (Current) End Target PEC instruments do not PEC instruments do not PEC instruments do use equated items and use equated items and not use equated items PEC reuslts from measure higher-order measure higher-order and measure higher- previous year are Value cognitive skills, and cognitive skills, and order cognitive skills, analyzed and results are not results are not and results are not disseminated in disseminated in disseminated in disseminated in actionable form actionable form actionable form actionable form Date 05-Jan-2016 14-Nov-2018 14-Nov-2018 30-Jun-2021 1/20/2019 Page 5 of 12 The World Bank Implementation Status & Results Report Pakistan: Third Punjab Education Sector Project (P154524) Revised instruments will include instruments that measure higher-order cognitive skills and contain items that are designed for inter-year equatability. The reporting of data in actionable form means that the data Comments: are analyzed, tailored and disseminated to relevant stakeholders (teachers/trainers, curriculum and textbook developers, and decision makers) in a form that is useful to them in deciding what actions can be taken to improve the quality of education. IN00606753 ►Percentage of new teachers recruited based on merit, for all vacant posts reallocated to schools as per recruitment policy (Percentage, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 100.00 100.00 100.00 100.00 Date 05-Jan-2016 14-Nov-2018 14-Nov-2018 30-Jun-2021 Measures the number of new teachers recruited based on merit for all vacant posts reallocated to schools Comments: as per recruitment policy, as a percentage of all new teachers recruited. IN00606750 ►Number of additional children enrolled in PPP initiatives supported by PEF under a quality assurance system (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 364,916.00 364,916.00 900,000.00 Date 05-Jan-2016 04-Jun-2018 04-Jun-2018 30-Jun-2021 Measures the number of children enrolled in additional schools covered by a PPP initiative and for which Comments: there is a quality assurance system strengthened by the Project. See also previous indicator. IN00606769 Number of additional girls enrolled in PPP initiatives supported by PEF under a quality assurance system (Number, Custom Breakdown) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 162,672.00 162,672.00 450,000.00 Date 05-Jan-2016 04-Jun-2018 04-Jun-2018 30-Jun-2021 IN00606770 Number of additional boys enrolled in PPP initiatives supported by PEF under a quality assurance system (Number, Custom Breakdown) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 202,244.00 202,244.00 450,000.00 Date 05-Jan-2016 04-Jun-2018 04-Jun-2018 30-Jun-2021 IN00606749 ►Number of additional schools covered by PPP initiatives supported by PEF under a quality assurance system (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 5,912.00 5,912.00 1,125.00 Date 05-Jan-2016 04-Jun-2018 04-Jun-2018 30-Jun-2021 Comments: Measures the number of additional schools covered by a PPP initiative and for which there is a quality assurance system strengthened by the Project. ‘Additional’ means schools that are not currently covered by PEF nor are they included in existing expansion plans. The quality assurance system will include the following: • The school enrolling the additional students has met targets associated with key performance indicators (KPIs) elaborated in the contract signed between PEF and the management contractor. • There will be the following minimum set of KPIs: 1/20/2019 Page 6 of 12 The World Bank Implementation Status & Results Report Pakistan: Third Punjab Education Sector Project (P154524) o Enrolment o Teacher attendance o Results of standardized testing. The tests to be used will be stipulated in the contract, and are likely to include PEC instruments and PEF Quality Assurance Tests. o Quality of infrastructure. The definition of quality will be stipulated in the contract. IN00606748 ►Number of additional children aged 6-16 years to whom a voucher is provided to pay low-cost private school tuition fees (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 365,686.00 365,686.00 420,000.00 Date 05-Jan-2015 14-Nov-2018 14-Nov-2018 30-Jun-2021 Measures the number of children to whom a voucher is provided to pay for low-cost private school tuition and who maintain an attendance rate at that school of at least 85%. At least half of the students enrolled at partner schools must achieve 40% on the annually administered Quality Assurance Test (QAT). This Comments: indicator will include only those children that participate in the EVS that uses a strengthened quality assurance system designed under the project (covering targeting and validation, and strengthened monitoring of partner schools); and that are supplemental to PEF’s current coverage and existing future IN00606767 expansion plans. Number of additional boys aged 6-16 years to whom a voucher is provided to pay low-cost private school tuition fees (Number, Custom Breakdown) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 200,995.00 200,995.00 210,000.00 Date 05-Jan-2016 14-Nov-2018 14-Nov-2018 30-Jun-2021 IN00606768 Number of additional girls aged 6-16 years to whom a voucher is provided to pay low-cost private school tuition fees (Number, Custom Breakdown) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 164,691.00 164,691.00 210,000.00 Date 05-Jan-2016 14-Nov-2018 14-Nov-2018 30-Jun-2021 IN00606747 ►Non-salary budget execution rate (Text, Custom) Baseline Actual (Previous) Actual (Current) End Target Value TBD TBD TBD TBD Date 04-Jun-2018 14-Nov-2018 14-Nov-2018 30-Jun-2021 Equivalent to the funds expended by schools against the NSB funds received by schools, as a percentage Comments: of the NSB funds received by schools IN00606746 ►Number of children aged 3-5 years enrolled in an ECE classroom that meets quality standards (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 0.00 210,000.00 Date 01-Jan-2016 04-Jun-2018 04-Jun-2018 30-Jun-2021 Measures the number of children enrolled in the classrooms that meet the quality standards (as described Comments: in previous indicator). IN00606765 1/20/2019 Page 7 of 12 The World Bank Implementation Status & Results Report Pakistan: Third Punjab Education Sector Project (P154524) Number of girls aged 3-5 years enrolled in an ECE classroom that meets quality standards (Number, Custom Breakdown) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 0.00 105,000.00 Date 01-Jan-2016 04-Jun-2018 04-Jun-2018 30-Jun-2021 IN00606766 Number of boys aged 3-5 years enrolled in an ECE classroom that meets quality standards (Number, Custom Breakdown) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 0.00 105,000.00 Date 01-Jan-2016 04-Jun-2018 04-Jun-2018 30-Jun-2021 Component 2: Capacity Building, Project Management, Monitoring, and Evaluation IN00660390 ►Number of EDOs-Education that analyze and act on revised district education report card generated from integrated database (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 -- 0.00 36.00 Date 05-Jan-2016 -- 04-Jun-2018 30-Jun-2021 Although the integrated database has only recently been established, district education report cards as well as district data packs are sent regularly to district officials for their action. The integrated dashboard Comments: has been established and training of EDOs on the use of dashboard and its generated district report cards is underway during this fiscal year. Disbursement Linked Indicators IN00659367 ►DLI 1 DLI 1: Private school vouchers Strengthening program design to expand coverage of tuition-replacement vouchers to children from disadvantaged households (Text, Outcome, 32,210,000.00, 53.34%) Baseline Actual (Previous) Actual (Current) 2020-21 • Vouchers to attend private schools provided to 322,679 10,000 Eligible Children children from received vouchers to disadvantaged households attend private schools; 420,000 Eligible • The program has and Children received Value undergone rapid -- vouchers to attend expansion, and present PEF’s Board of Directors private schools. design features need to be approved the Revised revisited to ensure more System for EVS. effective beneficiary selection and monitoring Date -- -- 31-May-2018 -- IN00659424 ►DLI 2 DLI 2. Public-private partnerships in education Leveraging the private sector to support schools to increase enrollment (Text, Output, 32,210,000.00, 53.34%) 1/20/2019 Page 8 of 12 The World Bank Implementation Status & Results Report Pakistan: Third Punjab Education Sector Project (P154524) Baseline Actual (Previous) Actual (Current) 2020-21 Currently 1.3 million 360,000 children are children are studying in enrolled through Public- PEF partner schools Private Partnerships under Value through the NSP and FAS. -- -- PEF approved programs Capacity to enroll additional that have a Strengthened children through PPPs Quality Assurance System remains Date -- -- 30-May-2018 -- IN00659720 ►DLI 3 DLI 3. Stipends for secondary school girls Stipends for secondary school girls to increase secondary school participation/retention (Text, Output, 32,210,000.00, 53.34%) Baseline Actual (Previous) Actual (Current) 2020-21 Stipends are offered to girls enrolled in secondary grades in 16 districts under SED continues to SED continues to the original program. implement the implement the Value The stipend amount and -- strengthened strengthened program in conditions have remained program in 16 16 Districts. unchanged since program Districts inception. Date -- -- 30-May-2018 -- IN00659734 ►DLI 4 DLI 4: Early childhood education Improving quality and expanding access to early childhood education (Text, Outcome, 32,210,000.00, 53.34%) Baseline Actual (Previous) Actual (Current) 2020-21 SED continues to 1,000 schools have implement its ECE is currently being classrooms that meet the recruitment policy Value implemented at a small -- Quality Standards for Merit-Based scale prescribed by the ECE Recruitment of new Policy Framework. teachers and reallocation of posts Date -- -- 30-May-2018 -- IN00659860 ►DLI 5 DLI 5: Human Resources Management Strengthening HR processes through continuous merit-based recruitment and rationalization of teaching posts (Text, Process, 32,210,000.00, 53.34%) Baseline Actual (Previous) Actual (Current) 2020-21 SED continues to implement its recruitment policy for Merit-Based SED continues to Merit-based recruitment of Recruitment of new implement its new teachers for all vacant teachers and reallocation recruitment policy Value posts reallocated to schools -- of posts. Third-party for Merit-Based based on existing validation of the SED’s Recruitment of new recruitment policy recruitment policy for Merit teachers and Based Recruitment of new reallocation of posts. teachers and reallocation of posts completed. Date -- -- 14-May-2018 -- IN00659872 1/20/2019 Page 9 of 12 The World Bank Implementation Status & Results Report Pakistan: Third Punjab Education Sector Project (P154524) ►DLI 6 DLI 6. Quality in the primary classroom Strengthening field- based CPD for improved teacher performance (Text, Outcome, 32,120,000.00, 0.00%) Baseline Actual (Previous) Actual (Current) 2020-21 Field-based system of CPD At least 85% of has mixed operational primary school capacity and performance, teachers in 18 Value and poor design match with -- Not applicable Districts covered by multigrade and large class New Mainstream teaching. Phase of integrated CPD program Date -- -- 31-May-2018 -- This DLI has not been achieved due to the change in organizational structure of the DSD, now called QAED. Comments: This is being restructured. IN00660333 ►DLI 7 DLI 7. Student Assessment PEC and its instruments strengthened within a revised policy framework (Text, Intermediate Outcome, 32,210,000.00, 0%) Baseline Actual (Previous) Actual (Current) 2020-21 No assessment policy Draft assessment policy framework; outdated PEC framework; PEC ISP in Value ISP that has been partially -- -- the process of implemented and is in need development of revision. Date -- -- 14-Nov-2018 -- IN00660334 ►DLI 8 DLI 8. School specific NSB Setting and executing school budgets in line with school resource needs (Text, Output, 32,210,000.00, 0%) Baseline Actual (Previous) Actual (Current) 2020-21 SED has prepared School-Specific Non-Salary Budgets for FY2020/21 in accordance with agreed funding SED has prepared formula, and School-Specific Non- submitted for Salary Budgets for inclusion in School-specific NSBs for FY2017/18 in FY2020/21 District FY2015/16 prepared in accordance with agreed budgets in 36 accordance with agreed funding formula, and Districts for all funding formula, and submitted for inclusion in schools, including submitted for inclusion in FY2018/19 District Value -- high/high secondary; FY2016/17 district budgets budgets in 36 Districts for and in 36 districts for all all schools, including Punjab’s Finance schools, including high/high high/high secondary; and Department has secondary. Punjab’s Finance dispersed School- Department has dispersed Specific Non-Salary 94% of the School Budgets bi-annually Specific Non-Salary to Budgets. schools with establishment of Necessary Support Structure for execution. 1/20/2019 Page 10 of 12 The World Bank Implementation Status & Results Report Pakistan: Third Punjab Education Sector Project (P154524) Date -- -- 30-Nov-2018 -- IN00660339 ►DLI 9 DLI 9. Data strengthening and performance management Strengthening management capacity and evidence-based decision-making (Text, Intermediate Outcome, 32,212,000.00, 0%) Baseline Actual (Previous) Actual (Current) 2020-21 PMIU has integrated Education sector data (from PEC, PMIU, DSD and PEF); and PMIU provided access Last private school census and orientation to the was in 2010-11. Various integrated database to education sector data are education departments Value not integrated, utilization of -- and District education -- data remains low and officials in 3 Districts; restricted to source PMIU has prepared and departments. delivered on a semiannual basis District performance report cards for Year 2 following agreed format and contents, to District Education Administrations Date -- -- 31-May-2018 -- Data on Financial Performance Disbursements (by loan) Project Loan/Credit/TF Status Currency Original Revised Cancelled Disbursed Undisbursed % Disbursed P154524 IBRD-86200 Effective USD 300.00 300.00 0.00 116.33 183.67 39% Key Dates (by loan) Project Loan/Credit/TF Status Approval Date Signing Date Effectiveness Date Orig. Closing Date Rev. Closing Date P154524 IBRD-86200 Effective 03-Jun-2016 31-Aug-2016 05-Oct-2016 31-Dec-2021 31-Dec-2021 Cumulative Disbursements 1/20/2019 Page 11 of 12 The World Bank Implementation Status & Results Report Pakistan: Third Punjab Education Sector Project (P154524) Restructuring History There has been no restructuring to date. Related Project(s) There are no related projects. 1/20/2019 Page 12 of 12