The World Bank College Education Development Project (P154577) REPORT NO.: RES36098 RESTRUCTURING PAPER ON A PROPOSED PROJECT RESTRUCTURING OF COLLEGE EDUCATION DEVELOPMENT PROJECT APPROVED ON JUNE 3, 2016 TO PEOPLE'S REPUBLIC OF BANGLADESH EDUCATION SOUTH ASIA Regional Vice President: Hartwig Schafer Country Director: Robert J. Saum Senior Global Practice Director: Jaime Saavedra Chanduvi Practice Manager/Manager: Mario Cristian Aedo Inostroza Task Team Leader: Shiro Nakata, Mokhlesur Rahman 1 The World Bank College Education Development Project (P154577) ABBREVIATIONS AND ACRONYMS CD Country Director CEDP College Education Development Project DLI Disbursement Linked Indicator DLR Disbursement Linked Results DPD Deputy Project Director DPP Development Project Proposal ECNEC Executive Committee of the National Economic Council ECPD Enhanced Continuous Professional Development EOP End of Project FY Fiscal Year GoB Government of Bangladesh IDA International Development Association IDG Institutional Development Grant IDP Institutional Development Plan MOE Ministry of Education MTR Mid-Term Review NTRCA National Teacher Registration and Certification Authority NTSC Non-government Teacher Selection Commission OM Operation Manual PD Project Director PDO Project Development Objective PG Post Graduate PMIS Project Management Information System PMU Project Management Unit SPC Strategic Planning Committee TOR Terms of Reference UNMC University of Nottingham Malaysia Campus US$ United States Dollar 2 The World Bank College Education Development Project (P154577) BASIC DATA Product Information Project ID Financing Instrument P154577 Investment Project Financing Original EA Category Current EA Category Partial Assessment (B) Partial Assessment (B) Approval Date Current Closing Date 03-Jun-2016 30-Jun-2022 Organizations Borrower Responsible Agency People's Republic of Bangladesh National University,Ministry of Education Project Development Objective (PDO) Original PDO The project development objectives are to strengthen the strategic planning and management capacity of the college education subsector and to improve the teaching and learning environment of participating colleges. OPS_TABLE_PDO_CURRENTPDO Summary Status of Financing Net Ln/Cr/Tf Approval Signing Effectiveness Closing Commitment Disbursed Undisbursed IDA-58410 03-Jun-2016 08-Sep-2016 13-Oct-2016 30-Jun-2022 100.00 25.08 73.06 Policy Waiver(s) Does this restructuring trigger the need for any policy waiver(s)? No 3 The World Bank College Education Development Project (P154577) I. PROJECT STATUS AND RATIONALE FOR RESTRUCTURING Overall Project Status 1. Progress towards achievement of Project Development Objectives (PDO) (a) Rating of PDO: PDOs are to strengthen the strategic planning and management capacity of the college education subsector and to improve the teaching and learning environment of participating colleges. Progress towards achievement of PDO has been Moderately Unsatisfactory based on the progress to date. (b) PDO level Indicators: The project has four PDO level indicators. Only PDO Indicator 2 (teacher vacancy) has achieved the year-wise target. The remaining PDO Indicator 1 (sector strategy), PDO Indicator 3 (teacher training) and PDO Indicator 4 (institutional development grants) have low likelihood of achieving the End of Project (EOP) targets within the original project period (i.e., June 30, 2019). 2. Overall Implementation Status (c) Prolonged stagnation and recent acceleration: The project faced nearly two years of stagnant implementation progress since its effectiveness because of prolonged staffing issues and weak capacity of project leaders which adversely impacted the implementation capacity at Project Management Unit (PMU). The Ministry of Education (MoE) has deployed the new Project Director (PD) and Deputy Project Director (DPD) in September 2018 to put in place an effective project leadership. The PMU under the new project leadership has been performing well to make up the initial delays in project implementation. The project implementation has picked up significant momentum under the new project leadership. Most of the key actions agreed during the mission in July 2018 and January 2019 have been completed or are about to be completed following strengthened staffing at the PMU. The project implementation progress is currently rated Moderately Satisfactory. (d) Disbursement: The total project cost is US$130 million (IDA: US$100 million, and GoB: US$30 million). The actual disbursement from IDA Credit as of January 13, 2019 was US$25 million, including US$23.3 million from achievement of Disbursement Linked Indicators (DLI) and US$1.7 million from the Special Account. The expected additional disbursement by end of FY2018-19 would be US$6 million from DLI and US$ 0.8 million from the Special Account. A. Rationale for Restructuring (a) The proposed restructuring including an extension of closing date by 18 months is necessary to achieve the PDOs. It would address the initial two-year stagnation of implementation progress which stemmed from unforeseeable level of weakness and staffing issue in the project leadership. The proposed restructuring would allow the project to continue the implementation of key interventions to achieve the PDOs and maintain the original end-of-project targets for all the PDO level indicators. (b) The Mid-Term Review (MTR) conduced in January 13-17, 2019 has confirmed that (i) the project implementation progress has picked up significantly and (ii) PDOs and all the project activities continue to be highly relevant to the sector. The Government of Bangladesh has sent a request letter for restructuring dated on March 3, 2019 with justifications. 4 The World Bank College Education Development Project (P154577) II. DESCRIPTION OF PROPOSED CHANGES B. Proposed Restructuring 1. Extension of closing date from June 2022 to December 2023: The closing date will be extended by 18 months to enable the achievement of the PDO which has been derailed by the stagnated implementation in the first two years from unforeseen level of weakness in project management capacity. To fit the new closing date and the revised activity implementation plan, changes will be required for Component 2, the Results Framework and the DLIs, which are discussed in detail below. 2. Changes to Component 2: Improving Teaching and Learning Environment in Participating Colleges a. Revising the basic approach in awarding the Institutional Development Grant (IDG) by reducing the number of rounds from two to one (Component 2.1): Two rounds of IDG award were originally planned to provide grants to a total of 122 colleges. To expedite the IDG program implementation, it was agreed that IDG awards to all the 122 colleges would be completed in one round. This allows the project to complete the target within the revised project period without any impact on the scope and results envisioned under this activity under the original design. This change will require revisions for related DLI (DLI 4) and indicators in the Result Framework (discussed below). b. Revising the teacher training design (Component 2.2): Design of the teacher training program under the partnership with University of Nottingham Malaysia Campus (UNMC) will be modified to include more hands-on practice-based Enhanced Continuous Professional Development (ECPD) courses for managers and teachers for stimulating school-based behavioral changes in teaching and learning practices. Certificate of Completion will be awarded upon successful completion of ECPD courses. This change will require revisions for related DLI (DLI 5) and indicators in the Result Framework (discussed below). 3. Changes in the Results Framework: To reflect the project closing date extension and the changes in component design, the Results Framework has been revised as following: (i) revision in intermediate and EOP target dates for three PDO indicators (sector strategy, teacher training and IDG) and all intermediate indicators; (ii) change in monitoring indicator description for PDO indicator 4 (IDG) to account for one round IDG instead of two; (iii) expansion of EOP target for intermediate indicator 2 ( beneficiary number) and indicator 8 ( number of awareness programs); (iv) revision in the definition of PDO indicator 3 (teacher training) to include the new ‘certificate of completion’ award under the redesigned activity. REVISED DESCRIPTION OF MONITORING INDICATORS PDO Level Results Indicators Revised Description The number of teachers and managers in Honours and Masters colleges (both government 3. Number of teachers and managers and nongovernment colleges) who are trained in subject, pedagogical, and managerial in Honours and Masters colleges trainings under the Project. Trainees are considered as trained when s/he completes a trained in subject and pedagogical Certificate of Completion or Post Graduate (PG) Certificate or Diploma course under the training under the Project Training Consortium. 4. Teaching and learning Each Institutional Development Plan (IDP) will set several activity milestones. The grant environment at Honours and supported colleges will report the activity progress by indicating the achievement of the Masters colleges upgraded (% of IDP milestones and will show the ratio of milestones achieved (for example, if there are five activity milestones achieved) milestones, completing two milestones will be 40percent achievement). The average 5 The World Bank College Education Development Project (P154577) milestone achievement ratio of the grant supported colleges will be calculated based on the self-reported semiannual reports and confirmed by the verification. 4. Changes in the DLIs: The changes in DLIs are as follows: (i) change in the DLI achievement dates for DL1 1 (strategic plan); DLI 3 (teacher management); DLI 4 (IDG) and DLI 5 (teacher training) to ensure completion of related implementation activities and to reflect the project closing extension; (ii) revision of the Disbursement Linked Results (DLR) description for DLI 4 to account for one round of IDG instead of two; and (iii) revision in the DLI verification protocol for DLI 5 (teacher training) to include the new ‘certificate of completion’ award. No other changes were made to the DLI verification protocols under the original project. 5. Disbursement arrangement and estimates: The changes to the DLIs with the extension imply a change to the disbursement arrangements as well as estimates as the DLRs are now spread over 6.5 years as against 5 years. This however does not imply any changes to the scope or end-of-project targets. I. SUMMARY OF CHANGES Changed Not Changed Results Framework ✔ Loan Closing Date(s) ✔ Disbursements Arrangements ✔ Implementation Schedule ✔ Implementing Agency ✔ DDO Status ✔ Project's Development Objectives ✔ Components and Cost ✔ Cancellations Proposed ✔ Reallocation between Disbursement Categories ✔ Disbursement Estimates ✔ Overall Risk Rating ✔ Safeguard Policies Triggered ✔ EA category ✔ Legal Covenants ✔ Institutional Arrangements ✔ 6 The World Bank College Education Development Project (P154577) Financial Management ✔ Procurement ✔ Other Change(s) ✔ Economic and Financial Analysis ✔ Technical Analysis ✔ Social Analysis ✔ Environmental Analysis ✔ IV. DETAILED CHANGE(S) OPS_DETAILEDCHANGES_LOANCLOSING_TABLE LOAN CLOSING DATE(S) Original Revised Proposed Proposed Deadline Ln/Cr/Tf Status Closing Closing(s) Closing for Withdrawal Applications IDA-58410 Effective 30-Jun-2022 31-Dec-2023 30-Apr-2024 . 7 The World Bank College Education Development Project (P154577) . Results framework COUNTRY: Bangladesh College Education Development Project Project Development Objectives(s) The project development objectives are to strengthen the strategic planning and management capacity of the college education subsector and to improve the teaching and learning environment of participating colleges. Project Development Objective Indicators by Objectives/ Outcomes RESULT_FRAME_TBL_PDO Indicator Name DLI Baseline Intermediate Targets End Target 1 2 3 4 5 6 To strengthen the strategic planning and management capacity of the college education subsector First draft of strategic plan is DPP has been Sector strategy and completed, No strategic plan is Background approved by action plan developed, discussed at a MoE approves the The first year available for the studies are drafted Executive and the initial DLI 1 consultation strategic plan and activities have been tertiary college by the expert Committee of the implementation started workshop, and action plan. implemented. subsector. groups. National Economic (Text) disclosed on the Council (ECNEC). MoE website for public comments. Action: This indicator has been Revised MoE has filled MoE has filled MoE has filled 900 Government college Vacancies: cumulatively, 1,500 cumulatively, MoE has completed government teacher vacancies filled DLI 2 2,700 government 2,700 government a needs assessment college teacher (Text) college teacher college teacher for teacher posts. vacancies. vacancies. vacancies. 8 The World Bank College Education Development Project (P154577) RESULT_FRAME_TBL_PDO Indicator Name DLI Baseline Intermediate Targets End Target 1 2 3 4 5 6 Action: This indicator has been Revised To improve the teaching and learning environment of participating colleges Number of teachers and MOE has managers in Honours and 5,000 college 8,000 college completed a need 800 teachers and 2,000 teachers and Masters colleges trained teachers and teachers and DLI 5 0.00 assessment for managers are managers are in subject and managers are managers are teachers and trained trained pedagogical training trained. trained. managers training. under the Project (Text) Action: This indicator has been Revised Teaching and learning environment at Honours and Masters colleges 0.00 0.00 0.00 0.00 10.00 20.00 50.00 70.00 upgraded (% of IDP activity milestones achieved) (Number) Action: This indicator has been Revised PDO Table SPACE Intermediate Results Indicators by Components RESULT_FRAME_TBL_IO Indicator Name DLI Baseline Intermediate Targets End Target 1 2 3 4 5 6 Component 1: Strengtheing the strategic planning and management capacity 9 The World Bank College Education Development Project (P154577) RESULT_FRAME_TBL_IO Indicator Name DLI Baseline Intermediate Targets End Target 1 2 3 4 5 6 Students benefiting from direct interventions to 0.00 800,000.00 900,000.00 1,800,000.00 1,900,000.00 2,000,000.00 2,100,000.00 2,100,000.00 enhance learning (CRI, Number) Action: This indicator has been Revised Students benefiting from direct interventions to 0.00 368,000.00 423,000.00 864,000.00 931,000.00 1,000,000.00 1,071,000.00 1,071,000.00 enhance learning - Female (CRI, Number) Action: This indicator has been Revised Management in the participating colleges strengthened (% of grant 0.00 0.00 0.00 0.00 20.00 30.00 50.00 80.00 supported colleges publish timely annual reports) (Percentage) Action: This indicator has been Revised Component 2: Improving the teaching and learning environment in participating colleges Number of colleges which completed self- 0.00 0.00 0.00 0.00 0.00 10.00 20.00 30.00 assessment for quality assurance (Number) 10 The World Bank College Education Development Project (P154577) RESULT_FRAME_TBL_IO Indicator Name DLI Baseline Intermediate Targets End Target 1 2 3 4 5 6 Action: This indicator has been Revised Increased satisfaction levels of students and Student: Student: teachers of grant Teacher: Teacher: Student:Teacher:(B supported colleges about n.a N.A N.A. N.A. (15% increase from N.A. (30% increase from aseline) teaching and learning the baseline) the baseline) environment (targets set by % increase) (Text) Action: This indicator has been Revised Component 3: Project Management, communication and monitoring and evaluation PMU is fully operational No Yes Yes Yes Yes Yes Yes Yes (Yes/No) Action: This indicator has been Revised Midterm and follow-up Tracer study Follow-up Tracer tracer study conducted n.a N.A. N.A. N.A. N.A N.A. conducted study conducted (Text) Action: This indicator has been Revised Web-based Project Management Development of PMIS fully PMIS fully PMIS fully PMIS fully functional Information System n.a N.A. N.A. the web-based functional and functional and functional and and regularly (PMIS) is established and PMIS initiated regularly updated regularly updated regularly updated updated regularly updated. (Text) 11 The World Bank College Education Development Project (P154577) RESULT_FRAME_TBL_IO Indicator Name DLI Baseline Intermediate Targets End Target 1 2 3 4 5 6 Action: This indicator has been Revised Awareness raising activities are regularly 0.00 2.00 4.00 8.00 10.00 12.00 14.00 16.00 conducted. (Number) Action: This indicator has been Revised IO Table SPACE Disbursement Linked Indicators Matrix DLI IN00679412 ACTION DLI 1 Development of college sub-Sector strategic plan Type of DLI Scalability Unit of Measure Total Allocated Amount (USD) As % of Total Financing Amount Output Yes Text 18,000,000.00 11.11 Period Value Allocated Amount (USD) Formula No strategic plan is available for the tertiary Baseline college subsector. MOE has established a national strategic planning Year 1 (Effectiveness–Dec committee and six expert groups under the terms 2,000,000.00 - 2017) of reference acceptable to the Association Year 2 (Jan–Dec 2018) 0.00 - The six expert groups have drafted background Year 3 (Jan-Dec 2019) 2,000,000.00 - studies. 12 The World Bank College Education Development Project (P154577) MOE has finalized a draft college sub-sector strategic plan, disclosed on the MoE website for Year 4 (Jan–Dec 2020) 4,000,000.00 - public comments, and carried out consultation workshops. MOE has: (a) approved the college sub-sector strategic plan; and (b) drafted at least one Year 5 (Jan-Dec 2021) 4,000,000.00 (a) US$2 million; (b) US$2 million Development Project Proposal (DPP) in line with the approved college sub-sector strategic plan Year 6 (Jan-Dec 2022) ECNEC has approved MOE’s DPP 4,000,000.00 - MOE has implemented the first year activities of Year 7 (Jan-Dec 2023) 2,000,000.00 - the DPP Action: This DLI is New DLI IN00679410 ACTION DLI 2 The number of government college teacher vacancies filled Type of DLI Scalability Unit of Measure Total Allocated Amount (USD) As % of Total Financing Amount Output Yes Text 18,000,000.00 66.67 Period Value Allocated Amount (USD) Formula Baseline Vacancies: 2,700 (a) MoE has submitted requisition of at least Year 1 (Effectiveness–Dec 2,700 government college teacher positions to 8,000,000.00 (a) US$4 million; (b) US$4 million 2017) the Public Service Commission; and (b) MOE has filled 900 government college teacher vacancies MOE has filled, cumulatively, 1500 government Year 2 (Jan–Dec 2018) 4,000,000.00 - college teacher vacancies. MOE has filled, cumulatively, 2700 government Year 3 (Jan-Dec 2019) 4,000,000.00 US$2 million for 600 college teacher vacancies. 13 The World Bank College Education Development Project (P154577) MOE has completed a needs assessment for new Year 4 (Jan–Dec 2020) 2,000,000.00 - teacher posts. Year 5 (Jan-Dec 2021) 0.00 - Year 6 (Jan-Dec 2022) 0.00 - Year 7 (Jan-Dec 2023) 0.00 - Action: This DLI is New DLI IN00679439 ACTION DLI 3 Improvement of teacher management system for nongovernment colleges Type of DLI Scalability Unit of Measure Total Allocated Amount (USD) As % of Total Financing Amount Output No Text 12,000,000.00 33.33 Period Value Allocated Amount (USD) Formula Baseline n/a The government has issued a gazette to amend Year 1 (Effectiveness–Dec rules of Non-Government Teachers Registration 4,000,000.00 - 2017) and Certification Authority (NTRCA) Year 2 (Jan–Dec 2018) 0.00 - The government has initiated drafting of Non- Year 3 (Jan-Dec 2019) government Teacher Selection Commission 2,000,000.00 - (NTSC) Act Year 4 (Jan–Dec 2020) The Cabinet of Ministers has approved NTSC Act 3,000,000.00 - The government has established the Non- Year 5 (Jan-Dec 2021) 3,000,000.00 - Government Teacher Selection Commission 14 The World Bank College Education Development Project (P154577) Year 6 (Jan-Dec 2022) 0.00 - Year 7 (Jan-Dec 2023) 0.00 - Action: This DLI is New DLI IN00679442 ACTION DLI 4 Improved teaching and learning environment in selected government and non-government colleges Type of DLI Scalability Unit of Measure Total Allocated Amount (USD) As % of Total Financing Amount Output Yes Text 22,000,000.00 9.09 Period Value Allocated Amount (USD) Formula Baseline No competitive funding to colleges in Bangladesh Year 1 (Effectiveness–Dec MOE has issued an operation manual for the 2,000,000.00 - 2017) colleges’ competitive funding program Year 2 (Jan–Dec 2018) 0.00 - MOE has signed Performance contracts with the Year 3 (Jan-Dec 2019) selected colleges for competitive funding in 4,000,000.00 - accordance with the operation manual On average 20% of the allocated budget of the Year 4 (Jan–Dec 2020) competitive funding is utilized in accordance with 4,000,000.00 - the operation manual On average 40% of the total allocated budget of Year 5 (Jan-Dec 2021) the competitive funding is utilized in accordance 4,000,000.00 US$2 million for 30% utilization with the operation manual On average 75% of the total allocated budget of Year 6 (Jan-Dec 2022) the competitive funding is utilized in accordance 4,000,000.00 US$2 million for 55% utilization with the operation manual 15 The World Bank College Education Development Project (P154577) On average 90% of the total allocated budget of Year 7 (Jan-Dec 2023) the competitive funding is utilized in accordance 4,000,000.00 US$2 million for 82% utilization with the operation manual Action: This DLI is New DLI IN00679413 ACTION Number of teachers and managers in Honours and Masters colleges trained in subject and pedagogical training under the DLI 5 Project Type of DLI Scalability Unit of Measure Total Allocated Amount (USD) As % of Total Financing Amount Output Yes Text 20,000,000.00 20.00 Period Value Allocated Amount (USD) Formula Baseline 0.00 (a) MOE has signed international partnership agreement with partners for the provision of Year 1 (Effectiveness–Dec teacher and manager training; and (b) MOE has 4,000,000.00 (a) US$2 million; (b) US$2 million 2017) completed a need assessment for teachers and managers training. Year 2 (Jan–Dec 2018) - 0.00 - Cumulatively 800 teachers and managers are US$2 million for 400 teachers and Year 3 (Jan-Dec 2019) 4,000,000.00 trained under the partnership. managers Cumulatively 2,000 teachers and managers are US$2 million for 1,400 teachers and Year 4 (Jan–Dec 2020) 4,000,000.00 trained under the partnership. managers trained Cumulatively 5,000 teachers and managers are US$2 million for 3,500 teachers and Year 5 (Jan-Dec 2021) 4,000,000.00 trained under the partnership. managers trained Cumulatively 8,000 college teachers and US$2 million for 6,500 teachers and Year 6 (Jan-Dec 2022) 4,000,000.00 managers are trained under the partnership. managers trained 16 The World Bank College Education Development Project (P154577) Year 7 (Jan-Dec 2023) - 0.00 - Action: This DLI is New Verification Protocol Table: Disbursement Linked Indicators DLI_TBL_VERIFICATION DLI 1 Development of college sub-Sector strategic plan Actions to be taken each year toward the development and approval of the Strategic Plan for the College Subsector and Description implementation of initial activities. MoE Data source/ Agency N.A. Verification Entity Verification Procedure and Sources The following documents will be submitted to the Bank team: (a) TOR of the national strategic planning committee and the expert groups cleared by the Bank Year 1 (b) A letter from the MoE secretary confirming the establishment of the national SPC (c) A signed minute of the first meeting of the national SPC Year 3 The first draft of six background studies Procedure The following documents will be submitted to the Bank team: (a) Completed six background studies Year 4 (b) A draft strategic plan which includes phased action plan (c) A report on the seven consultation workshops The following documents will be submitted to the Bank team: (a) Th e approved strategic plan Year 5 including action plans (b) The first draft of the DPP Year 6 The following document/s will be submitted to the Bank team: the approved DPP. 17 The World Bank College Education Development Project (P154577) The following document/s will be submitted to the Bank team: a progress report on the first year Year 7 activities. DLI_TBL_VERIFICATION DLI 2 The number of government college teacher vacancies filled The number of vacant teacher posts filled in all the government colleges (including Degree (pass), Honours, and Masters colleges). The number of vacant posts at the entry level as of 2016 is 2,700. The vacancies will be considered as filled when Description MoE have completed recruitment of teachers and appointed teachers to government colleges. The DSHE will conduct a needs assessment of teacher posts to assess the gaps and additional requirement of teacher posts in colleges. MOE/PMU Data source/ Agency N.A. Verification Entity Verification Procedure and Sources The following documents will be submitted to the Bank team: (a) Ministry of Public Administration (MoPA) requisition letter submitted to Public Service Commission Year 1 for filling up the identified vacancies in the government colleges (b) A letter from the MoE co nfirming the newly recruited teachers are appointed Procedure The following document/s will be submitted to the Bank team: a letter from the MoE confirming that Year 2 the newly recruited teachers are appointed. The following document/s will be submitted to the Bank team: a letter from the MoE confirming the Year 3 newly recruited teachers are appointed. The following document/s will be submitted to the Bank team: a completed needs assessment for new Year 4 teacher posts. DLI_TBL_VERIFICATION DLI 3 Improvement of teacher management system for nongovernment colleges Definitions The Government Gazette will be issued to amend the rules of nongovernment teacher registration Description under the NTRCA. Year 1 18 The World Bank College Education Development Project (P154577) The government will start drafting an act for NTSC. Year 3 Year 4 The draft NTSC Act will be approved by the cabinet of ministers. Year 5 Nongovernment Teacher Selection Commission will be established. MOE/NU Data source/ Agency N.A. Verification Entity Verification Procedure and Sources The following documents will be submitted to the Bank team: Year 1 A copy of the gazette issued by the government Procedure Year 3 The first draft NTSC Act Year 4 The following document/s will be submitted to the Bank team: the cabinet approved draft NTSC Act. The following document/s will be submitted to the Bank team: the Government Gazette on the NTSC Year 5 Act. DLI_TBL_VERIFICATION DLI 4 Improved teaching and learning environment in selected government and non-government colleges Definitions The Operations Manual (OM) will be developed to describe the procedures for selection and implementation of the IDG program. Description The OM will be developed based on the agreed table of contents. The main areas to be covered in the Year 1 OM will include objectives; planning and budgeting procedures; selection procedures and criteria; procurement, financial and subproject management procedures; reporting and monitoring procedures; and all the necessary templates. 19 The World Bank College Education Development Project (P154577) Performance Contracts will be signed with the competitive grants awarded government and Year 3 nongovernment colleges. Grant supported colleges will submit utilization reports to the PMU. The average utilization rate will be calculated as the total amount of utilized fund divided by the total Year 4, amount of grants awarded to colleges. Year 5, Year 6 Suspended grants divided by cancelled grants will be excluded from the calculation. A survey based on the agreed TOR will verify at least 50% of the grant supported subprojects. Grant supported colleges will submit utilization reports to the PMU. The average utilization rate will be calculated as the total amount of utilized fund divided by the total Year 7 amount of grants awarded to colleges. Suspended grants divided by cancelled grants will be excluded from the calculation. MOE/PMU Data source/ Agency A Survey Firm hired based on agreed ToR for Year 4, 5 and 6 DLRs. Verification Entity Verification Procedure and Sources The following documents will be submitted to the Bank team: Year 1 The completed operations manual Procedure The following documents will be submitted to the Bank team: The signed Performance Contracts for Year 3 all the selected colleges Year 4, The following documents will be submitted to the Bank team: Year 5, (a) Fund utilization report 20 The World Bank College Education Development Project (P154577) Year 6 (b) Verification report indicating compliance with the OM Year 7 The following document/s will be submitted to the Bank team: fund utilization report. DLI_TBL_VERIFICATION Number of teachers and managers in Honours and Masters colleges trained in subject and pedagogical training under the DLI 5 Project The cumulative number of teachers and managers in Honours and Masters colleges (both government and nongovernment colleges) who are trained in subject, pedagogical, and managerial trainings under the Project. Trainees are considered as Description trained when s/he completes a Certificate of Completion or PG Certificate or Diploma course under the Training Consortium. MOE/PMU Data source/ Agency A survey firm hired based on agreed ToR for Year 5 DLR. Verification Entity Verification Procedure and Sources Year 1 The following document/s will be submitted to the Bank team: the signed partnership agreement. Procedure Year 3, The following document/s will be submitted to the Bank team: consolidated training completion Year 4, reports. Year 6 The following documents will be submitted to the Bank team: (i) consolidated training completion Year 5 reports; and (ii) a verification report. 21 The World Bank College Education Development Project (P154577) ANNEX 1: DEFINITIONS AND DESCRIPTION OF MONITORING INDICATORS PDO Level Results Indicators Description 1. Sector strategy and action plan Actions to be taken each year toward the development and approval of the developed, adopted, and the initial Strategic Plan for the College Subsector and implementation of initial activities. implementation started The number of vacant teacher posts filled in all the government colleges (including Degree (pass), Honours, and Masters colleges). The number of vacant posts at the entry level as of 2016 is 2,700. The vacancies will be considered as filled when 2. Government college teacher MoE have completed recruitment of teachers and appointed teachers to vacancies reduced government colleges. The DSHE will conduct a needs assessment of teacher posts to assess the gaps and additional requirement of teacher posts in colleges. The number of teachers and managers in Honours and Masters colleges (both 3. Number of teachers and managers in government and nongovernment colleges) who are trained in subject, Honours and Masters colleges trained in pedagogical, and managerial trainings under the Project. Trainees are considered subject and pedagogical training under as trained when s/he completes a Certificate of Completion or PG Certificate or the Project Diploma course under the Training Consortium. Each IDP will set several activity milestones. The grant supported colleges will report the activity progress by indicating the achievement of the milestones and 4. Teaching and learning environment at will show the ratio of milestones achieved (for example, if there are five Honours and Masters colleges upgraded milestones, completing two milestones will be 40percent achievement). The (% of IDP activity milestones achieved) average milestone achievement ratio of the grant supported colleges will be calculated based on the self-reported semiannual reports and confirmed by the verification. Intermediate Results Indicators Description (indicator definition and so on) The number of students enrolled/registered and teachers in each year in all 1. Number of beneficiaries (of which % government and nongovernment NU affiliated colleges in the tertiary level of female beneficiaries) (includes all NU courses, including Degree (pass), Honours, and Masters courses, excluding HSC affiliated tertiary level college students) students. Grant supported colleges will be required to prepare and submit annual reports to the PMU within a certain period stipulated in the OM to show information about 2. Management in the participating the institution as well as the progress of institutional development activities. This colleges strengthened (% of grant indicator captures the ratio of IDG supported colleges which submit and publish supported colleges publish timely annual reports within the stipulated time for the respective year. Late submissions annual reports) will not be counted. Publication can be made by means of posting on the college website or any other means that are publicly accessible. The cumulative number of government and nongovernment colleges which 3. Number of colleges which completed completed at least one self-assessment in accordance with the self-assessment self-assessment for quality assurance guideline prepared by the Project 4. Increased satisfaction levels of The increase in the average level of satisfaction about teaching and learning students and teachers of grant environment among students and teachers as measured in the form of Likert scale supported colleges about teaching and of 1 to 5, with 5 being fully satisfied. The data will be obtained through three The World Bank College Education Development Project (P154577) learning environment (targets set by % rounds of satisfaction surveys in years 1, 3, and 5. Teachers will be asked about increase) their satisfaction over the teaching environment. The indicator will measure whether or not the PMU is fully operational. Being fully operational is defined as having met three of the following four conditions: (a) Staffing (70 percent of PMU staff are in place); (b) Procurement (at least 70 5. PMU is fully operational percent of the procurement was completed as intended in the Procurement Plan); (c) Monitoring & Evaluation (at least 70 percent of the intended reports published and activities completed); and (d) Financial Management (the previous IUFR is completed in time). 6. Midterm and follow-up tracer study Implementation and completion of each of the two rounds of the tracer study conducted Development and regular updating of the PMIS. Being fully functional and regularly updated is defined as having met the following conditions: (a) the system 7. Web-based PMIS is established and is online and accessible; (b) the database is updated by more than 70 percent of regularly updated the grant supported colleges; and (c) the latest news of the Project are posted regularly. The cumulative number of awareness raising campaigns conducted centrally by 8. Awareness raising activities are the PMU and the implementing agencies. Awareness raising campaign includes regularly conducted print and electronic media, workshops and seminars, and so on.