Public Disclosure Copy The World Bank Implementation Status & Results Report Support to Implementation of the Regional Education Strategy (P158836) Support to Implementation of the Regional Education Strategy (P158836) LATIN AMERICA AND CARIBBEAN | OECS Countries | Education Global Practice | Recipient Executed Activities | Investment Project Financing | FY 2017 | Seq No: 2 | ARCHIVED on 20-Dec-2017 | ISR30746 | Implementing Agencies: OECS Commission, Education Management Unit, OECS Commission, Ministry of Education, Dominica, Ministry of Education, Grenada, Ministry of Education, St. Lucia, Ministry of Education, St. Vincent and the Grenadines Key Dates Key Project Dates Bank Approval Date:05-Jul-2016 Effectiveness Date:27-Jul-2016 Original Closing Date:30-Sep-2019 Revised Closing Date:30-Sep-2019 Project Development Objectives Project Development Objective (from Project Appraisal Document) The objectives of the Project are to: (i) use quality learning standards to support evidence based teaching and learning at the primary level; (ii) improve teacher practices at the primary level; (iii) strengthen primary school leadership and accountability and (iv) initiate the strengthening of sector monitoring and evaluation capacity in support of evidence-based strategic management and decision-making, all in the Member Countries. Has the Project Development Objective been changed since Board Approval of the Project Objective? No PHRPDODEL Components Name Overall Ratings Name Previous Rating Current Rating Progress towards achievement of PDO  Moderately Unsatisfactory  Moderately Unsatisfactory Overall Implementation Progress (IP)  Moderately Unsatisfactory  Moderately Unsatisfactory Implementation Status and Key Decisions Implementation of activities has made good progress since the project launch in April 2017. All four components have made some progress and three of them have advanced significantly. Specifically, on component 1, the Inception report for curriculum and assessment has been submitted and accepted. Data capturing has been completed for St. Lucia and is currently underway in Grenada. The expected completion date for this task is August 2018. On component 2, the Inception Report was submitted and accepted. The draft report on Teacher Professional Development was 12/20/2017 Page 1 of 8 Public Disclosure Copy Public Disclosure Copy The World Bank Implementation Status & Results Report Support to Implementation of the Regional Education Strategy (P158836) shared with the four countries for feedback. Each of the four countries is in the process of nominating 10 persons to form a national professional development team, with the goal of ensuring sustainability and integration into national systems from an early stage. On component 3, design of the training program for school leaders is underway. On component 4, the inception report, the CLASS baseline analysis, and a draft M&E report (manual) were produced. The M&E report for the project, which includes measures of appropriateness, efficiency, effectiveness, impact, and sustainability, have been shared with the four participating countries. The plan is to do a formative (mid-school year) and a summative (end of school year) measurement of teacher performance, student achievement, use of assessment frameworks, and engagement in continuous professional development. After the project launch mission in April 2017, the World Bank team reviewed the results framework and identified the need for restructuring. The rationale for restructuring is as follows: 1 . Impact Indicators 1 and 2, which focus on learning outcomes in mathematics and literacy, are so far downstream in the results chain that a meaningful impact cannot be expected within the life of the project; additionally, there is a lack of comparable and continuous data across countries. 2 . Similarly, progress on Project Development Objective (PDO) indicator 2, the percentage of teachers rated effective in classroom practices, is more than can reasonably be expected during the life of the project given that the project activities alone would not improve classroom practices without complementary country-level activities, which will require time to implement. 3 . All five PDO indicators are not needed, since one PDO indicator per component would be sufficient. PDO indicators 3 and 4 both pertain to the same component, and PDO indicator 3 appears more suited to being an Intermediate Result Indicator (IRI). 4 . The CLASS instrument, on which IRI 7 is based, may not be a sustainable method of monitoring project results, given its cost and requirements for frequent recertification of classroom observers. 5 . The targets for the current PDO indicators 1 and 3 will need to be revised based on developments since project preparation. The restructuring will only affect the Results Framework and is expected to be completed in February 2018. The next implementation support mission is tentatively scheduled for April 2018. Risks Overall Risk Rating Risk Category Rating at Approval Previous Rating Current Rating Overall  --  Low  Low Results Project Development Objective Indicators PHINDPDOTBL % of pupils reading at or above their grade level at the key stages of grade 2 by sex, urban-rural residence (This is an Impact Indicator) (Percentage, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 9.00 9.00 9.00 10.00 Date 30-Sep-2016 26-Jun-2017 30-Nov-2017 30-Aug-2019 12/20/2017 Page 2 of 8 Public Disclosure Copy Public Disclosure Copy The World Bank Implementation Status & Results Report Support to Implementation of the Regional Education Strategy (P158836) PHINDPDOTBL % of pupils by sex and urban-rural residence performing at or above the minimum standards at grade 2 in Mathematics (This is an Impact Indicator) (Percentage, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 0.00 10.00 Date 30-Sep-2016 26-Jun-2017 30-Nov-2017 30-Aug-2019 PHINDPDOTBL Percentage of primary teachers using formative assessment based on learning standards (Percentage, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 0.00 50.00 Date 30-Aug-2016 26-Jun-2017 30-Nov-2017 30-Aug-2019 PHINDPDOTBL Percentage of teachers rated effective on classroom practices (Percentage, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 70.00 70.00 70.00 73.00 Date 30-Aug-2016 26-Jun-2017 30-Nov-2017 30-Aug-2019 PHINDPDOTBL Percentage of primary schools with a School Improvement Plans (SIP) focused on learning outcomes (Percentage, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 75.00 75.00 75.00 50.00 Date 30-Aug-2016 26-Jun-2017 30-Nov-2017 30-Aug-2019 12/20/2017 Page 3 of 8 Public Disclosure Copy Public Disclosure Copy The World Bank Implementation Status & Results Report Support to Implementation of the Regional Education Strategy (P158836) PHINDPDOTBL Percentage of school leaders reporting on progress of teachers practices and students learning to oversight bodies (Percentage, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 0.00 50.00 Date 30-Aug-2016 26-Jun-2017 30-Nov-2017 30-Aug-2019 PHINDPDOTBL Production of an annual report on plan implementation and performance indicators at the country level (Yes/No, Custom) Baseline Actual (Previous) Actual (Current) End Target Value N N N Y Date 30-Aug-2016 26-Jun-2017 30-Nov-2017 30-Aug-2019 Overall Comments The restructuring will affect the PDO indicators as follows: Impact Indicators 1 and 2, which focus on learning outcomes in mathematics and literacy will be deleted as they are beyond the scope and timeline of project. PDO Indicator 2 “Percentage of teachers rated effective on classroom practices” will be deleted and replaced with current IRI 3 (Number of teachers trained and certified) as due to current PDO indicator 2 is more than can reasonably be expected from project activities. PDO Indicator 3 “Percentage of primary schools with a School Improvement Plans (SIP) focused on learning outcomes” will be made into an IRI. Currently there are two PDO indicators for leadership and accountability; if this indicator is moved to an IRI then each part of the PDO will have one indicator. PDO Indicators 1, 4 and 5 will remain the same. Intermediate Results Indicators PHINDIRITBL Learners-centered assessment framework and guidelines for using learning standards approved (Yes/No, Custom) Baseline Actual (Previous) Actual (Current) End Target Value N N N Y Date 30-Aug-2016 26-Jun-2017 30-Nov-2017 30-Aug-2019 12/20/2017 Page 4 of 8 Public Disclosure Copy Public Disclosure Copy The World Bank Implementation Status & Results Report Support to Implementation of the Regional Education Strategy (P158836) PHINDIRITBL Teacher professional development course developed (Yes/No, Custom) Baseline Actual (Previous) Actual (Current) End Target Value N N N Y Date 30-Aug-2016 26-Jun-2017 30-Nov-2017 30-Aug-2019 PHINDIRITBL Number of teachers trained and certified as competent (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 0.00 540.00 Date 30-Aug-2016 26-Jun-2017 30-Nov-2017 30-Aug-2019 PHINDIRITBL Handbook for School Leaders (Yes/No, Custom) Baseline Actual (Previous) Actual (Current) End Target Value N N N Y Date 30-Aug-2016 26-Jun-2017 30-Nov-2017 30-Aug-2019 PHINDIRITBL School leadership training program developed (Yes/No, Custom) Baseline Actual (Previous) Actual (Current) End Target Value N N N Y Date 30-Aug-2016 26-Jun-2017 30-Nov-2017 30-Aug-2019 12/20/2017 Page 5 of 8 Public Disclosure Copy Public Disclosure Copy The World Bank Implementation Status & Results Report Support to Implementation of the Regional Education Strategy (P158836) PHINDIRITBL Number of school leaders certified in a competence based standards (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 0.00 125.00 Date 30-Aug-2016 26-Jun-2017 30-Nov-2017 30-Aug-2019 PHINDIRITBL Number of teachers monitored through the Classroom Assessment Scoring System (CLASS) (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 416.00 416.00 400.00 Date 30-Aug-2016 26-Jun-2017 30-Nov-2017 30-Aug-2019 PHINDIRITBL Number of schools analyzing and using student learning data (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 0.00 300.00 Date 30-Aug-2016 26-Jun-2017 30-Nov-2017 30-Aug-2019 PHINDIRITBL M&E Manual Developed (Yes/No, Custom) Baseline Actual (Previous) Actual (Current) End Target Value N N Y Y Date 30-Aug-2019 26-Jun-2017 30-Nov-2017 30-Aug-2019 Overall Comments The restructuring will affect the IRI indicators as follows: IRI 3 “Number of teachers trained and certified as competent” will be move to PDO Indicator 2 and reworded as “Number of teachers satisfactorily completing teacher professional development course in classroom practices”. IRI 7 “Number of teachers monitored through the Classroom Assessment Scoring System (CLASS)” will be deleted since the project may drop CLASS. IRI 8 “Number of schools analyzing and using student learning data” will be deleted as it is already covered by PDO Indicator 3. No 12/20/2017 Page 6 of 8 Public Disclosure Copy Public Disclosure Copy The World Bank Implementation Status & Results Report Support to Implementation of the Regional Education Strategy (P158836) changes will be made to IRIs 1, 2, 4, 5, 6, and 9. Data on Financial Performance Disbursements (by loan) Project Loan/Credit/TF Status Currency Original Revised Cancelled Disbursed Undisbursed Disbursed P158836 TF-A2937 Effective USD 2.00 2.00 0.00 0.41 1.59 21% Key Dates (by loan) Project Loan/Credit/TF Status Approval Date Signing Date Effectiveness Date Orig. Closing Date Rev. Closing Date P158836 TF-A2937 Effective 05-Jul-2016 27-Jul-2016 27-Jul-2016 30-Sep-2019 30-Sep-2019 Cumulative Disbursements Restructuring History There has been no restructuring to date. 12/20/2017 Page 7 of 8 Public Disclosure Copy Public Disclosure Copy The World Bank Implementation Status & Results Report Support to Implementation of the Regional Education Strategy (P158836) Related Project(s) There are no related projects. 12/20/2017 Page 8 of 8 Public Disclosure Copy