The World Bank Report No: ISR13661 Implementation Status & Results Pakistan Pakistan: Second Sindh Education Sector Project (P125952) Public Disclosure Copy Operation Name: Pakistan: Second Sindh Education Sector Project (P125952) Project Stage: Implementation Seq.No: 3 Status: ARCHIVED Archive Date: 29-Jul-2014 Country: Pakistan Approval FY: 2013 Product Line: IBRD/IDA Region: SOUTH ASIA Lending Instrument: Specific Investment Loan Implementing Agency(ies): Reform Support Unit, Reform Support Unit Key Dates Board Approval Date 14-Mar-2013 Original Closing Date 30-Jun-2017 Planned Mid Term Review Date Last Archived ISR Date 08-Jan-2014 Effectiveness Date 19-Mar-2014 Revised Closing Date 30-Jun-2017 Actual Mid Term Review Date Project Development Objectives Project Development Objective (from Project Appraisal Document) The project supports the Sindh Government’s Second Sindh Education Sector Reform Program (SERP II). The Project Development Objective is to raise school participation by improving sector governance and accountability and strengthening administrative systems, and measure student achievement. Has the Project Development Objective been changed since Board Approval of the Project? Yes No Component(s) Component Name Component Cost Results-based component: Financing of the Sindh Government's Second Sindh Education Sector 393.00 Reform Program (SERP II) Technical Assistance (TA) component: Financing of essential technical, advisory, capacity building 7.00 support for SERP II Overall Ratings Previous Rating Current Rating Public Disclosure Copy Progress towards achievement of PDO Satisfactory Satisfactory Overall Implementation Progress (IP) Moderately Satisfactory Satisfactory Overall Risk Rating Substantial Substantial Implementation Status Overview The Second Sindh Education Sector Support Program, approved by the Board on March 14, 2013, was signed on November 28, 2013 and became effective on March 19, 2014. The delay in signing of the Financing Agreement was due to setting up of the new government at the provincial and federal level following the general elections held in early 2013. Effectiveness was delayed due to delays in submission of the Government's Legal Opinion as well as the need to carry out a project restructuring to revise several legal covenants. Considering these substantial delays in effectiveness, and the related delays in budget releases to ELD, the Department has done a remarkable job in project implementation. Seven (7) out of the ten (10) Disbursement-linked indicators (DLIs) are considered fully met; three (3) have been partially met. However, the expenditures in the Education sector remained Page 1 of 11 The World Bank Report No: ISR13661 low due to late releases, therefore the disbursement against eligible expenditure programs is calculated to be less than the amount against the achieved DLIs. Once program expenditures reach a higher level, disbursements would be made against all achieved DLIs fully. Public Disclosure Copy Locations Country First Administrative Division Location Planned Actual Pakistan Sindh Sindh ✔ Results Project Development Objective Indicators Indicator Name Core Unit of Measure Baseline Current End Target Middle, Net enrollment rate, age 11-13 Percentage Value 35.70 36.00 40.90 Date 30-Mar-2012 30-Jun-2014 30-Jun-2017 Comments Student Achievement Test (SAT) Yes/No Value Yes Yes Yes Date 18-Apr-2012 30-Jun-2014 30-Jun-2016 Comments Pilot (1st) round of a Grade 5 2013/14 SAT exam conducted Annual rounds of SAT for competency based test Grade 5 and 8 implemented administered in Government schools Primary, Net enrollment rate, 6-10 years Percentage Value 61.60 62.00 69.70 Date 30-Mar-2012 30-Jun-2014 30-Jun-2017 Comments Matriculate, Net enrollment rate, ages 14-15 Percentage Value 23.00 25.00 26.00 years Date 30-Mar-2012 30-Jun-2014 30-Jun-2016 Comments Intermediate Results Indicators Public Disclosure Copy Page 2 of 11 The World Bank Report No: ISR13661 Indicator Name Core Unit of Measure Baseline Current End Target DLI 1: Program budget and expenditure Text Value Under SERP, the preparation Partially Met i) Sindh has approved the management and submission of budgets FY2015/16 budget for the Public Disclosure Copy was rushed, there were financing of all the initiatives delays in seeking and under SERP II and released it releasing funds for time- in full, in accordance with a sensitive activities, and there cash plan, acceptable to the were issues in the payments Association; (ii) Sindh has for completed activities and made payments against services rendered. approved expenditures under SEPR II in full and in accordance with a schedule of expenditures, acceptable to the Association; and (iii) ED has prepared the FY2016/17 budgetfor the financing of all the initiatives under SERP II and submitted it for review and approval. Date 30-Jan-2013 30-Jun-2014 30-Jun-2016 Comments Delays in timely budget releases to the Education Department resulted in non- achievement of the first part of this DLI. The Department will ensure preparation of cash plans to ensure timely follow up with Finance Department according to the FY 2014/15 budget. DLI 4: School budgets Text Value Salary and nonsalary budgets Met (i) All Sindh’s districts have prepared following needs- prepared school-specific based criteria for primary, budgets for FY2016/17 for Public Disclosure Copy middle, and elementary 100% of eligible schools using schools for FY2012/13 the revised needs-based prepared, authorized, and criteria; (ii) Sindh has approved. approved school-specific non- salary budgets for FY2015/16 Third party contracted to for all eligible schools, and provide implementation and released themper a schedule, monitoring support to districts. acceptable to the Association; (iii) a third party has reviewed the compliance of school non- salary expenditures Page 3 of 11 The World Bank Report No: ISR13661 forFY2015/16 with the with the applicable financial management and procurement guidelines and Public Disclosure Copy the Framework for Fund Utilization of School Specific Budget. Date 30-Jan-2013 30-Jun-2014 30-Jun-2016 Comments (i) All Sindh’s districts have prepared school-specific budgets for FY2014/15 for 100% of eligible schools using needs-based criteria, acceptable to the Association; (ii) Sindh has approved school-specific non-salary budgets for FY2013/14 for all eligible schools, and released them per a schedule, acceptable to the Association; (iii) a third party contracted by ED has reviewed the compliance of school non- salary expenditures for FY2013/14 with the applicable financial management and procurement guidelines and the Framework for Fund Utilization of School Specific Budget; and (iv) Sindh has revised the Public Disclosure Copy needs-based criteria for the determination of school- specific non-salary budgets, in a manner acceptable to the Association. 30-Jun-2014. DLI 5: School Management Committees Text Value 82% of eligible schools Met (i) RSU has assessed all received SMC grants in their applications for SMC Grants SMC bank accounts in for academic year 2015/16, in FY2011/12. accordance with qualification Page 4 of 11 The World Bank Report No: ISR13661 criteria and screening A total of 5,025 schools procedures, acceptable to the received capacity building Association; (ii) 100% of the services via contracted NGOs SMCs with approved Public Disclosure Copy in 8 districts in FY2009/10 applications have received and FY2010/11. the SMC Grants for academic year 2015/16; and (iii) RSU Schools provided with SMC has provided support services guidelines and other (including communication, materials. awareness-raising, grievance management, and facilitation services) to SMCs, in accordance with a plan, acceptable to the Association. Date 30-Jan-2013 30-Jun-2014 30-Jun-2016 Comments Approximately 55% SMCs screened successfully and provided SMC grants. The team will continue to put in extra efforts to ensure all functional, eligible schools receive the SMC grant. DLI 2: Annual School Census Text Value ASC for academic year i) A third party has 2011/12 completed and data administered the ASC for available; data finalization academic year 2015/16 in steps remaining pending due thirteen (13) districts, in to major delays during the accordance with a design and activity. an administration plan, acceptable to the Association; Preparation for ASC for (ii) ED has administered the academic year 2012/13 ASC for academic year underway but seriously off- 2015/16 in the remaining track. districts, in accordance with a design and an administration Public Disclosure Copy plan, acceptable to the Association; and (iii) at least 100% of Sindh’s secondary and higher secondary schools report ASC data through a web-based direct reporting IT platform Date 30-Jan-2013 30-Jun-2014 30-Jun-2016 Comments RSU/Education Department is in the final stages of procuring Page 5 of 11 The World Bank Report No: ISR13661 the services of a third party firm for data collection in three districts. This process needs to be finalized as early as Public Disclosure Copy possible. Staffing for ASC also needs to be improved to ensure the data collection process can be completed in a timely manner. DLI 3: Student Achievement Test Text Value Pilot round of SAT (a Met A third party has administered competency-based test for the fifth round of the student grade 5) administered to achievement test in language, students in grades 6 in mathematics and science for government schools in April grades 5 and 8 for academic 2012. Data processing and year 2015/16 using test analysis currently underway. design, administration, quality The Sindh government is assurance, and data use plan renewing the contract for and manual, revised as per conducting the SAT for therecommendations of the academic year 2012/13. extensive review conducted in 2014/15, in a manner acceptable to the Association. Date 30-Jan-2013 30-Jun-2014 30-Jun-2016 Comments SAT 2013/14 implemented in all districts, final report of the SAT test submitted by the contractor. DLI 6: School system consolidation Text Value A large share of distinct Met (i) Sindh has consolidated at government schools operating least 75% of the schools in the same building, same approved for consolidation in compound, or catering to the FY2015/16; and (ii) ED has same child population in the organized existing and/or local community. provided additional staffing and other resources for all Public Disclosure Copy As of December 2012, as schools consolidated prior to recorded in SEMIS, 1,068 FY2015/16, so as to function government schools as singleschools consolidated in eleven districts, yielding 414 consolidated schools and 648 merged schools. Date 30-Jan-2013 30-Jun-2014 30-Jun-2016 Comments School consolidation targets achieved however there are Page 6 of 11 The World Bank Report No: ISR13661 serious deficiencies in the implementation at school level for the school to function as an efficient single unit. Public Disclosure Copy DLI 7: School infrastructure development: Text Value As of December 2012, three Met (i) Sindh has provided to rounds of school rehabilitation Sindh’s districts annual grants under the district Terms of for FY2015/16 TOP, in Partnership (TOP) initiative accordance performance and undertaken in all 23 districts. needs based criteria Under TOP II and III, 1,801 andratios, acceptable to the schools (89% of screened-in Association; (ii) Sindh has schools) were rehabilitated selected 100% of the schools and met agreed construction to be rehabilitated/upgraded quality and design under FY2015/16 TOP,in specifications as certified by a accordance with – acceptable third party. to the Association – qualification criteria and Civil works under TOP IV screening procedures applied (FY2012/13) initiated in 19 by a third party; (iii)athird districts, with third party party has validated that at supervision of the process least 90% of qualifying and construction. schools under FY2012/13, FY2013/14 and FY2014/15 TOP have been fully constructed in accordance with construction timelines and quality standards and school design specifications, acceptable to the Association, and delivered for use to the districts; and (iv) Sindh has implemented pilot programs for environmental enhancements of existingschools, in Public Disclosure Copy accordance with a plan acceptable to the Association Date 30-Jan-2013 30-Jun-2014 30-Jun-2016 Comments The targets of this year have been met; some work on need assessment of schools to be upgraded and rehabilitated is ongoing and is Page 7 of 11 The World Bank Report No: ISR13661 expected to be completed soon. DLI 8: Public-private partnership in education Text Value PPRS program financed Partially met (i) Sindh has financed the through the development PPRS Program through its Public Disclosure Copy budget to expire on June 30, recurrent budget; (ii) 100% of 2013. As of December 2012, the schools participating in three rounds of entry into the the PPRS Program are program completed, and 385 supported in compliance with PPRS schools in operation in partnership contracts and educationally-disadvantaged under quality assurance and areas in 10 districts. accountability systems, all acceptable to the Association; Pilot quality assurance test in and (iii) SEF has undertaken sample PPRS program an additional round of school schools administered in May entries into the PPRS 2012. Second quality Program in FY2015/16, in assurance test in all schools accordance with qualifying administered in January 2013. criteria and screening procedures, acceptable to the Association. Date 30-Jan-2013 30-Jun-2014 30-Jun-2016 Comments This DLI can be considered met with the completion of the additional (fourth) round of school entries into the PPRS Program within FY2013/14. All other activities have been achieved DLI 9: Education management Text Value Currently no authorized Partially Met (i) Sindh has approved new headteacher positions for education management primary, middle, and positions for FY2016/17; (2) elementary schools. Sindh has authorized that the Education management education management positions in the districts filled positions for FY2015/16 are Public Disclosure Copy by appointing headteachers filled in accordance with from secondary and higher notified appointment rules, secondary schools, without acceptable to the Association; provision and enforcement of (iii) Sindh has offered to all well-specified job appointed education descriptions, job guidelines managers in contracts with and tools, tailored training, performance terms and and performance criteria and conditions, acceptable to the procedures Association; and (iv) Sindh has provided to all the Page 8 of 11 The World Bank Report No: ISR13661 contracted education managers induction training, job guidelines, and management resources and Public Disclosure Copy assessed their performance annually using performance evaluation tools and procedures, all acceptable to the Association. Date 30-Jan-2013 30-Jun-2014 30-Jun-2016 Comments ELD/RSU has made excellent progress in drafting an Education Management Cadre policy, teaching cadre has also been reviewed and suggestions are being finalized with wide consultations. DLI 10: : Teacher management Text Value First round of recruitment of (i) Sindh has carried out any general teachers following recruitment of any type of merit-based criteria teachers for government completed. Second round of schools only for needs-based recruitment of general vacancies and on a merit- teachers following merit- based selection, in based criteria and filling accordance with rules, needs-based vacancies acceptable to the Association; completed. Third round of (ii) Sindh has offered recruited merit- and needs-based teachers contracts with recruitment initiated. performance terms and conditions, acceptable to the Association; and (iii) Sindh has provided to all contracted teacher inductiontraining, job guidelines, and management Public Disclosure Copy resources and assessed their performance annually using performance evaluation tools and procedures, all acceptable to the Association. Date 30-Jan-2013 30-Jun-2014 30-Jun-2016 Comments Significant progress has been made on finalizing HST and JST recruitments and contract finalization. PST recruitments Page 9 of 11 The World Bank Report No: ISR13661 were delayed due to slow response from districts; however the team has increased the pace of work Public Disclosure Copy and will be finalize the recruitment process. Induction training has been initiated for the teachers that have received the contracts. Data on Financial Performance (as of 18-Jun-2014) Financial Agreement(s) Key Dates Project Ln/Cr/Tf Status Approval Date Signing Date Effectiveness Date Original Closing Date Revised Closing Date P125952 IDA-52180 Effective 14-Mar-2013 28-Nov-2013 19-Mar-2014 30-Jun-2017 30-Jun-2017 Disbursements (in Millions) Project Ln/Cr/Tf Status Currency Original Revised Cancelled Disbursed Undisbursed % Disbursed P125952 IDA-52180 Effective XDR 259.60 259.60 0.00 51.76 207.84 20.00 Disbursement Graph Public Disclosure Copy Key Decisions Regarding Implementation Page 10 of 11 The World Bank Report No: ISR13661 In order to ensure efficient and timely progress on education reforms in the next FY, the Reform Support Unit (RSU) will prepare a quarterly cash plan, approved by ELD and World Bank, and submit to the Finance Department (FD), with the understanding that the FD will issue releases to the ELD on the basis of approved cash plan. The RSU will also prepare a detailed work plan for achievement of targets against each DLI, highlighting key procurement time lines. Public Disclosure Copy Restructuring History Level 2 CD Decision on 10-Feb-2014 Related Projects There are no related projects. Public Disclosure Copy Page 11 of 11