The World Bank Report No: ISR13410 Implementation Status & Results Kazakhstan Technical & Vocational Education Modernization (TVEM) (P102177) Public Disclosure Copy Operation Name: Technical & Vocational Education Modernization (TVEM) Project Stage: Implementation Seq.No: 8 Status: ARCHIVED Archive Date: 29-Jan-2014 (P102177) Country: Kazakhstan Approval FY: 2011 Product Line: IBRD/IDA Region: EUROPE AND CENTRAL ASIA Lending Instrument: Specific Investment Loan Implementing Agency(ies): Key Dates Board Approval Date 08-Jul-2010 Original Closing Date 31-Dec-2013 Planned Mid Term Review Date 28-Jun-2013 Last Archived ISR Date 29-Jul-2013 Effectiveness Date 09-Aug-2011 Revised Closing Date 31-Dec-2014 Actual Mid Term Review Date 20-Jun-2013 Project Development Objectives Project Development Objective (from Project Appraisal Document) The Project Development Objective is to raise the relevance, quality, and efficiency of technical and vocational education (TVE) through an improved policy framework and institutional capacity. Has the Project Development Objective been changed since Board Approval of the Project? Yes No Component(s) Component Name Component Cost Develop standards and quality assurance for TVE 2.40 Strengthen governance, management and financing 1.60 Strengthen skills delivery capacity 29.20 Overall Ratings Public Disclosure Copy Previous Rating Current Rating Progress towards achievement of PDO Moderately Satisfactory Satisfactory Overall Implementation Progress (IP) Moderately Unsatisfactory Moderately Satisfactory Overall Risk Rating Moderate Moderate Implementation Status Overview Following the mid-term review in June, 2013, and in response to a government request, the Bank approved in July , 2013, one-year extension of the project to December 30, 2014. The extension is to allow the project to run its full course, which was designed to be implemented in a three-year period but the government's ratification process caused delays of effectiveness pushing back the actual implementation schedule for a year. The project has been steady since the last review. The new leadership of MOES steered the project implementation effectively by removing several internal bureaucratic hurdles thus cleared the way for signing the pending contracts for technical assistance and successful closing of Page 1 of 6 The World Bank Report No: ISR13410 the second round of the competitive grants. Successful resolution of these procurement backlogs resulted in accelerated pace of procurement, the delivery of the remaining technical assistance and the completion of the second round of competitive grants for 41 TVE colleges advancing the pace and level of loan disbursement significantly. The loan disbursement to date has risen to US$19 million accounting for 65% of the loan and US$8 million up from the last ISR period. Public Disclosure Copy More specifically, technical assistance contracts for project evaluation, pilot of per capital financing, and development of core curriculum were signed and launched which mark the completion of the procurement process for the planned technical assistance under all three components. This would allow the key policy and institutional development activities be fully completed within the extended implementation schedule. The second and final round of the competitive grants was launched in the second half 2013 and completed in December, 2013. 137 public and private TVE training institutions participated in the competition through submission of their self-developed Institutional Development Plans (IDP). Following a two-stage review and evaluation, 41 colleges including 6 private colleges were awarded with grants for implementation of the approved IDPs. Together with the first round of the grants to 27 TVE colleges, the total grant recipient TVE colleges reached 68. A technical and fiduciary review in December 2013 on the grants awarded through the first round in 2012 showed clearly that the implementation is on track in supporting the innovation and reforms proposed in their IDPs and the financial management at the institutional level is satisfactory. In light of the positive result of this competitive financing pilot, the new leadership of MOES embraced the approach and intends to scale it up from the project financed TVE colleges to the government's financing of higher education. The implementation progress to date including an increasing number of performance indicators met and faster disbursement has enhanced the likelihood of full achievement of project development objectives with demonstrated early impact on the TVE system. Locations No Location data has been entered Results Project Development Objective Indicators Indicator Name Core Unit of Measure Baseline Current End Target Share of the existing programs in the projects Percentage Value 0.00 0.00 100.00 supported schools revised in accordance with Date 13-Jun-2011 07-Jan-2014 31-Dec-2014 the newly introduced competency standards. Comments This indicator is contingent on the approval of the new standards which are being reviewed before official approval. Employer satisfaction with industry-led Percentage Value 0.00 44.00 60.00 Public Disclosure Copy competency standards as a basis for Date 13-Jun-2011 07-Jan-2014 31-Dec-2014 development of curriculum and programs. Comments The base line is confirmed as A recent research shows 44% zero as the development of of the new standards new standards is a ground developed have been officially breaking effort initiated by the endorsed by the employers project, which did not exist through the sector councils as before the project started. the evidence of satisfaction. Intermediate Results Indicators Page 2 of 6 The World Bank Report No: ISR13410 Indicator Name Core Unit of Measure Baseline Current End Target Share of project schools that planned and Text Value 0.0 60.0 100% introduced programs that use competency- Date 13-Jun-2011 07-Jan-2014 31-Dec-2014 Public Disclosure Copy based curriculum. Comments Share of teachers in each project school Text Value 0.0 25% 2-5% trained indeveloping and delivering new CBT Date 13-Jun-2011 07-Jan-2014 31-Dec-2014 programs. Comments Target exceeded. Share of schools that implement the grants in Percentage Value 0.00 80.00 90.00 accordance with the targets set in their IDPs Date 13-Jun-2011 07-Jan-2014 31-Dec-2014 (out of schools that received grants). Comments Share of private TVE institutions that received Text Value 0.0 14% not less than 30% grants (out of schools that received grants). Date 13-Jun-2011 07-Jan-2014 31-Dec-2014 Comments Share of lyceums/colleges that received grants Number Value 0.00 68.00 97.00 (out of total number). Date 13-Jun-2011 07-Jan-2014 31-Dec-2014 Comments Number of in-service teacher-training programs Number Value 0.00 6.00 6.00 developed in the area of CBT (progressive Date 13-Jun-2011 07-Jan-2014 31-Dec-2014 total). Comments target met. Number of updated educational standards Number Value 0.00 0.00 147.00 supported with revised core curriculum. Date 13-Jun-2011 07-Jan-2014 31-Dec-2014 Comments contract is under implementation. Number of educational standards updated in Number Value 0.00 0.00 10.00 line with occupational standards. Date 13-Jun-2011 07-Jan-2014 31-Dec-2014 Comments contract is under implementation. Public Disclosure Copy Impact evaluation study completed and report Text Value 0.0 0.0 1.0 generated. Date 13-Jun-2011 07-Jan-2014 31-Dec-2014 Comments Contract is under implementation. Plan developed for nationwide implementation Text Value 0.0 0.0 1.0 of formula-based financing. Date 13-Jun-2011 07-Jan-2014 31-Dec-2014 Comments Contract for TA is under implementation. Page 3 of 6 The World Bank Report No: ISR13410 Formula-based financing mechanism piloted in Text Value 0.0 0.0 1.0 one or two regions. Date 13-Jun-2011 07-Jan-2014 31-Dec-2014 Comments Piloting will follow the study to Public Disclosure Copy be launched in 2014. Formula-based financing policy options studied Text Value 0.0 0.0 1.0 and proposal developed. Date 13-Jun-2011 07-Jan-2014 31-Dec-2014 Comments Implementation plan for the governance and Text Value 0.0 0.0 1.0 management improvement prepared, Date 13-Jun-2011 07-Jan-2014 31-Dec-2014 budgeted, and adopted by MOES. Comments Policy recommendations are being considered by MOES before official adoption. Study completed on governance and Text Value 0.0 1.0 1.0 management of TVE at all levels with policy Date 13-Jun-2011 07-Jan-2014 31-Dec-2014 options generated. Comments target met. target met. Share of project schools with established Percentage Value 0.00 60.00 100.00 boards (with participation of employers). Date 01-Jun-2010 07-Jan-2014 31-Dec-2014 Comments Number of priority (10) sectors which Number Value 4.00 10.00 10.00 established councils. Date 13-Jun-2011 07-Jan-2014 31-Dec-2014 Comments target met. target met. National and sector councils have at least one- Percentage Value 35.00 100.00 100.00 third of members from the industry. Date 13-Jun-2011 07-Jan-2014 31-Dec-2014 Comments 4 existing out of priority 10 target met. Number of project schools that passed Number Value 0.00 0.00 10.00 independent institutional accreditation (at least Date 13-Jun-2011 07-Jan-2014 31-Dec-2014 one school from eachof 10 priority sectors). Comments Development of the Public Disclosure Copy accreditation program has been completed but accreditation is voluntary. Accreditation standards and mechanisms Text Value 0.0 1.0 1.0 developed Date 01-Jun-2010 07-Jan-2014 31-Dec-2014 Comments Target met. Page 4 of 6 The World Bank Report No: ISR13410 Share of newly developed occupational Percentage Value 0.00 0.00 100.00 standards forwhich qualification assessment Date 01-Jun-2010 07-Jan-2014 31-Dec-2014 tools prepared. (out of number of new Comments standards developed to date) Public Disclosure Copy Share of occupations covered by new Percentage Value 0.00 65.00 100.00 standards out of total number of occupationsin Date 01-Jun-2010 07-Jan-2014 31-Dec-2014 the priority sectors supported by the project Comments NQF and key elements of NQS formally Text Value 0.0 1.0 1.0 adopted by the GOK. Date 13-Jun-2011 07-Jan-2014 31-Dec-2014 Comments target met. target met. Legal framework, includingregulations, revised Text Value 0.0 0.0 1.0 andapproved by GOK. Date 13-Jun-2011 07-Jan-2014 31-Dec-2014 Comments Concept of NQS and NQF approved by GOK Text Value 0.0 1.0 1.0 and employers. Date 13-Jun-2011 07-Jan-2014 31-Dec-2014 Comments target met. target met. Data on Financial Performance (as of 13-Dec-2013) Financial Agreement(s) Key Dates Project Ln/Cr/Tf Status Approval Date Signing Date Effectiveness Date Original Closing Date Revised Closing Date P102177 IBRD-79310 Effective 08-Jul-2010 24-Nov-2010 09-Aug-2011 31-Dec-2013 31-Dec-2014 Disbursements (in Millions) Project Ln/Cr/Tf Status Currency Original Revised Cancelled Disbursed Undisbursed % Disbursed P102177 IBRD-79310 Effective USD 29.23 29.23 0.00 18.78 10.45 64.00 Public Disclosure Copy Disbursement Graph Page 5 of 6 The World Bank Report No: ISR13410 Public Disclosure Copy Key Decisions Regarding Implementation The progress since the last review is encouraging. Keeping the pace and momentum in the next six months would be key to successful completion of the project. Restructuring History Level 2 CD Decision on 26-Jul-2013 Related Projects There are no related projects. Public Disclosure Copy Page 6 of 6