The World Bank Implementation Status & Results Report Belarus Education Modernization Project (P148181) Belarus Education Modernization Project (P148181) EUROPE AND CENTRAL ASIA | Belarus | Education Global Practice | IBRD/IDA | Investment Project Financing | FY 2016 | Seq No: 9 | ARCHIVED on 12-Dec-2019 | ISR39623 | Implementing Agencies: Ministry of Education, Republic of Belarus Key Dates Key Project Dates Bank Approval Date: 17-Sep-2015 Effectiveness Date: 20-Jan-2016 Planned Mid Term Review Date: 08-Oct-2018 Actual Mid-Term Review Date: 10-Sep-2018 Original Closing Date: 28-Feb-2021 Revised Closing Date: 28-Feb-2025 pdoTable Project Development Objectives Project Development Objective (from Project Appraisal Document) The objectives of the proposed Project are to: (i) improve access to quality learning environment in selected general secondary schools; and (ii) strengthen student assessment and education management information systems of the Republic of Belarus. Has the Project Development Objective been changed since Board Approval of the Project Objective? Yes Board Approved Revised Project Development Objective (If project is formally restructured) The objectives of the proposed Project are to: (i) improve access to a quality learning environment in selected general secondary education institutions; and (ii) strengthen the Belarus' student assessment and education management information systems. Components Table Name Ensuring a Quality Learning Environment in General Secondary Institutions receiving Students from closed/reorganized General Secondary Institutions:(Cost $138.33 M) Modernization of System Management in Education:(Cost $10.86 M) Support for the Implementation, Monitoring and Evaluation of the Project:(Cost $3.80 M) Overall Ratings Name Previous Rating Current Rating Progress towards achievement of PDO Satisfactory Satisfactory Overall Implementation Progress (IP) Satisfactory Satisfactory Overall Risk Rating Moderate Moderate Implementation Status and Key Decisions 12/12/2019 Page 1 of 10 The World Bank Implementation Status & Results Report Belarus Education Modernization Project (P148181) Belarus Education Modernization Project shows good progress towards Project Development Objectives (PDO), and its implementation is on track. Additional Financing (AF) of the project is now effective and in full force since October 2, 2019. The delayed indicators from the previous supervision were improved, and the Project Implementation Unit (PIU) has worked to address ongoing implementation bottlenecks Currently, the disbursement under the project amounts to USD 27.45 million, it is slightly behind the planned USD 33.0 million for December 31, 2019. The project team suggests keeping the ratings, except for component two of the project, which becomes crucially important for the expanded project. Component's two activity related to the Education Management and Information System (EMIS) showed most delays during the initial project implementation. Recently, the PIU has improved on the National Assessment implementation by arranging the international conference and initiating the discussions on the implementation of the expanded component. The Programme for International Student Assessment - PISA subcomponent 2.2 is the best performing activity of the project. The PISA 2018 results were announced for Belarus, therefore delivering on the major project indicator. The Project Implementation Unit (PIU) and the government showed satisfactory performance. The new director of PIU is appointed and the major positions of the departments are filled. The Bank is currently reinforcing the training program on different operational aspects of the Project to support the PIU in enhancing the implementation of the project. For the component two, the PIU and the government have planned a series of seminars to plan the implementation of the extended project activities. Monitoring and Evaluation (M&E). The M&E of the project is performing moderately satisfactorily. PDO and intermediary indicators are progressing well. As the reworked Results Framework of the Project was introduced and currently in full force, the Bank team would request the changed reporting from the PIU. Citizen Engagement. A project beneficiary satisfaction survey linked to the citizen engagement indicators in the results framework was conducted in December 2018, and the results showed a positive change in project schools as compared to the control group in terms of beneficiary satisfaction with the quality of the learning environment. The study will be repeated in December 2019. Risks Systematic Operations Risk-rating Tool Risk Category Rating at Approval Previous Rating Current Rating Political and Governance Moderate Moderate Moderate Macroeconomic Moderate Substantial Substantial Sector Strategies and Policies Moderate Moderate Moderate Technical Design of Project or Program Moderate Moderate Moderate Institutional Capacity for Implementation and Sustainability Substantial Substantial Substantial Fiduciary Substantial Substantial Substantial Environment and Social Moderate Moderate Moderate Stakeholders Moderate Moderate Moderate Other -- -- -- Overall Moderate Moderate Moderate Results PDO Indicators by Objectives / Outcomes 12/12/2019 Page 2 of 10 The World Bank Implementation Status & Results Report Belarus Education Modernization Project (P148181) Ensuring a quality learning environment in GSEIs receiving students from closed/reorganized GSEIs IN00775695 ►Students benefitting from an improved learning environment in general secondary schools targeted by the project (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 16,888.00 20,102.00 65,000.00 Date 17-Sep-2015 31-Dec-2018 05-Dec-2019 28-Feb-2025 Total number of students enrolled in project schools which meet the minimum conditions of a quality Comments: learning environment per the quality learning environment checklist. IN00775748 Female students benefiting from improved learning environment (Number, Custom Breakdown) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 8,392.00 10,050.00 32,500.00 Date 17-Sep-2015 31-Dec-2018 05-Dec-2019 28-Feb-2025 IN00775749 Students from closed/reorganized schools accomodated in schools with improved learning environment (Number, Custom Breakdown) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 2,415.00 2,550.00 13,000.00 Date 17-Sep-2015 31-Dec-2018 05-Dec-2019 28-Feb-2025 IN00775750 Female students from closed/reorganized schools benefitting from improved learning environment (Number, Custom Breakdown) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 1,187.00 1,275.00 6,500.00 Date 17-Sep-2015 31-Dec-2018 05-Dec-2019 28-Feb-2025 IN00775751 ►Impact evaluation study on the progress of project schools in the improvement of quality of learning environment and its use as per the international study on learning environments is conducted (Text, Custom) Baseline Actual (Previous) Actual (Current) End Target According to international methodology, project schools apply Value No study is completed No study is completed No study is completed successful elements of the intervention and show better progress as compared to the control group. Date 17-Sep-2015 17-May-2019 05-Dec-2019 28-Feb-2025 Modernization of System Management in Education IN00775746 12/12/2019 Page 3 of 10 The World Bank Implementation Status & Results Report Belarus Education Modernization Project (P148181) ►Republic of Belarus’s participation in PISA is supported (Text, Custom) Baseline Actual (Previous) Actual (Current) End Target Belarus conducted PISA Belarus participate in 2018 testing in May PISA 2018 results are PISA 2018, 2021, and No participation in 2018. The results have published for Belarus (subject to Value international been submitted to the on December 3, 2019. Government decision) assessments OECD and will be Belarus enrolled in in PISA 2024. All published in December PISA 2021. results are published 2019. for Belarus Date 17-Sep-2015 17-May-2019 05-Dec-2019 28-Feb-2025 Comments: All of the necessary PISA 2018 data is submitted to and accepted by the OECD. IN00775747 ►Annual education statistics reports produced using data generated by the integrated EMIS (Text, Custom) Baseline Actual (Previous) Actual (Current) End Target The integrated EMIS of Annual report No integrated EMIS in Belarus for general The integrated EMIS is produced with100% of Value place education is under under development. its data generated by development. EMIS Date 17-Sep-2015 17-May-2019 30-Jun-2019 28-Feb-2025 Reports providing education statistics are produced on an annual basis using the integrated EMIS that is Comments: developed under the project. Overall Comments PDO For several of indicators the baseline is not available or studies were not conducted because they were introduced as part of the Additional Financing, that has become effective on October 2, 2019. Intermediate Results Indicators by Components Ensuring a quality learning environment in GSEIs receiving students from closed/reorganized GSEIs IN00775752 ►Number of schools rehabilitated under the project to meet minimum conditions for a quality learning environment (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 37.00 52.00 300.00 Date 17-Sep-2015 31-Dec-2018 05-Dec-2019 28-Feb-2025 IN00775755 ►Number of schools that received innovative teaching and learning clusters on science subjects (Physics, Chemistry, Computer Science, Biology) (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 0.00 21.00 Date 17-Sep-2015 19-Feb-2019 05-Dec-2019 28-Feb-2025 IN00775759 12/12/2019 Page 4 of 10 The World Bank Implementation Status & Results Report Belarus Education Modernization Project (P148181) Number of participants of the STEM related activities and classes (Number, Custom Breakdown) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 0.00 5,000.00 Date 17-Sep-2015 19-Feb-2019 05-Dec-2019 28-Feb-2025 IN00775760 Number of female participants of the STEM related activities and classes (Number, Custom Breakdown) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 0.00 2,500.00 Date 17-Sep-2015 19-Feb-2019 05-Dec-2019 28-Feb-2025 IN00775762 ►Number of rehabilitated schools targeted by the project, providing social and cultural services to the population (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 0.00 21.00 Date 17-Sep-2015 19-Feb-2019 05-Dec-2019 28-Feb-2025 IN00775764 Number of social and cultural activities organized at the centers (Number, Custom Breakdown) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 0.00 120.00 Date 17-Sep-2015 19-Feb-2019 05-Dec-2019 28-Feb-2025 IN00775766 ►Beneficiaries reporting improved satisfaction with the quality of learning environment, relative to an appropriate control group (Text, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 Satisfaction is statistically Participants of the Satisfaction is higher in the treatment educational process statistically higher in schools than in control representing the treatment schools schools educational institutions than in control schools covered by the Project note the following: 1. conditions created in their educational institutions notably ensure barrier-free environments for students with disabilities (according to 58.3% of students and 40.9% of teachers participating in the opinion poll, which is 8-10% higher indicator in comparison with the control group) and improve the level of student safety as a result of installation of video cameras, turnstiles, etc (78.8% 12/12/2019 Page 5 of 10 The World Bank Implementation Status & Results Report Belarus Education Modernization Project (P148181) of students and 67.9% of teachers; 12.5% higher in comparison with the indicator obtained in the control group of students; 9.3% higher indicator in case of teachers); 2. condition of a building hosting an educational institution was rated as fully satisfactory by 78.3% of students and 71.1% of students 'parents, which is 9% more in comparison with the indicator obtained in the control group; 67.6% of teachers rated the condition as satisfactory, which is 16.2% higher indicator in comparison with the control group; condition of classrooms was rated as satisfactory by 78.1% of students, 66.8% of students'parents and 66.0% of teachers, which is 6.6%, 8.8% and 14.4% higher indicators in comparison with the control group); 3. state of laboratory equipment for physics (51.5% of students)and chemistry (32.4% of students) practical and laboratory work is rated as modern. Corresponding indicators in the control group are lower by 16.5% and 8.1%; during the training in the subject all the relevant laboratory equipment is always available (59.2% of physics teachers; 43.9% of chemistry teachers), which is 16.8% and 7.2% higher that in the control group. Date 17-Sep-2015 19-Feb-2019 30-Jun-2019 28-Feb-2025 IN00775767 12/12/2019 Page 6 of 10 The World Bank Implementation Status & Results Report Belarus Education Modernization Project (P148181) ►Number of schools supplied with laboratory equipment under the project (either one or a combination of Physics, Chemistry, Computer Science, Biology) (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 24.00 24.00 279.00 Date 17-Sep-2015 17-May-2019 05-Dec-2019 28-Feb-2025 Modernization of System Management in Education IN00775753 ►Improved national system of education quality assessment (Text, Custom) Baseline Actual (Previous) Actual (Current) End Target A plan to improve the national system for assessing educational achievements based on the sample of students in institutions of general secondary education (republican monitoring) was developed. By the year 2020, the plan would support: 1) the development of a concept and a model of A concept and a model the republican monitoring of the republican of the quality of general monitoring of the secondary education, quality of general taking into account the secondary education, purposes and directions criteria and indicators of using the results of the for assessing the assessment; quality of general 2) the development of a secondary education Assessment of the Existing sample-based program of the are developed. quality of education Value national assessment republican monitoring of The procedure for with new tools system in place the quality of general conducting monitoring conducted. secondary education, surveys has been taking into account the improved through the need for information of development, testing interested persons; and use of an 3) the development of automated system for criteria, indicators and collecting and tools for assessing the processing research quality of general data. secondary education, taking into account the competence approach; 4) the improvement of the procedure for conducting monitoring surveys in accordance with the developed concept, model and program of the republican monitoring; 5) the evaluation of the educational achievements of students 12/12/2019 Page 7 of 10 The World Bank Implementation Status & Results Report Belarus Education Modernization Project (P148181) using the improved national sample based system (republican monitoring). Date 17-Sep-2015 17-May-2019 30-Jun-2019 28-Feb-2025 The national sample-based assessment (Republican monitoring) is improved through the capacity building Comments: of the National Institute ofEducation and is implemented on a nationally representative sample of students. The assessment results are submitted to and acceptedby the Ministry of Education. IN00775756 ►Analytical work on PISA research results in the Republic of Belarus completed (Text, Custom) Baseline Actual (Previous) Actual (Current) End Target Developed recommendations for the development of Main testing of PISA PISA 2018 results are educational policies 2018 was completed in published for Belarus and national Belarus. National report on December 3, 2019. assessment based on Value No analytical work on PISA 2018 for Belarus Belarus enrolled in the results of PISA will be PISA 2021. 2021 research. A ready in the end of 2019. comparative analysis of the results of 2018 and 2021 carried out Date 17-Sep-2015 17-May-2019 05-Dec-2019 25-Feb-2021 Comments: National report with PISA 2018 is prepared and disseminated IN00775758 ►Number of education managers trained in the use of the integrated EMIS (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 0.00 7,210.00 Date 17-Sep-2015 19-Feb-2019 05-Dec-2019 28-Feb-2025 Total number of administrative staff who have completed training on the use of the integrated EMIS. Comments: IN00775761 Number of female education managers trained in the use of the integrated EMIS (Number, Custom Breakdown) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 0.00 6,380.00 Date 17-Sep-2015 19-Feb-2019 05-Dec-2019 28-Feb-2025 IN00775763 ►Number of education managers that received training and capacity building in modernization of the education system (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 0.00 1,770.00 Date 17-Sep-2015 19-Feb-2019 05-Dec-2019 28-Feb-2025 IN00775765 Number of female education managers that received training and capacity building in modernization of the education system (Number, Custom Breakdown) 12/12/2019 Page 8 of 10 The World Bank Implementation Status & Results Report Belarus Education Modernization Project (P148181) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 0.00 1,000.00 Date 17-Sep-2015 19-Feb-2019 05-Dec-2019 28-Feb-2025 Support for the Implementation, Monitoring and Evaluation of the Project IN00775754 ►Percent of beneficiaries reporting that community center activities represented the views of the community, students, and teachers (Percentage, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 0.00 80.00 Date 17-Sep-2015 19-Feb-2019 05-Dec-2019 28-Feb-2025 IN00775757 ►Percent of school users who consider that the project implementation responded to their views (Percentage, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 0.00 80.00 Date 17-Sep-2015 19-Feb-2019 05-Dec-2019 28-Feb-2025 Overall Comments IR For several of indicators the baseline is not available or studies were not conducted because they were introduced as part of the Additional Financing, that has become effective on October 2, 2019. Data on Financial Performance Disbursements (by loan) Project Loan/Credit/TF Status Currency Original Revised Cancelled Disbursed Undisbursed % Disbursed P148181 IBRD-85290 Effective USD 50.00 50.00 0.00 27.35 22.65 55% P148181 IBRD-89430 Effective USD 102.30 102.30 0.00 0.41 101.87 0.4% Key Dates (by loan) Project Loan/Credit/TF Status Approval Date Signing Date Effectiveness Date Orig. Closing Date Rev. Closing Date P148181 IBRD-85290 Effective 17-Sep-2015 23-Sep-2015 20-Jan-2016 28-Feb-2021 28-Feb-2025 P148181 IBRD-89430 Effective 18-Apr-2019 26-Apr-2019 02-Oct-2019 28-Feb-2025 28-Feb-2025 Cumulative Disbursements 12/12/2019 Page 9 of 10 The World Bank Implementation Status & Results Report Belarus Education Modernization Project (P148181) Restructuring History There has been no restructuring to date. Related Project(s) P166719-Belarus Education Modernization Project - Additional Financing 12/12/2019 Page 10 of 10