DDI_ARM_2007_MCC-WMIS_v01_M Millennium Challenge Corporation 2013-07 NADA Version 2.0 (April 2015). Edited version based on Version 01 (DDI-MCC-ARM-MPR-WTM-ISSA-2010-2011-v01) that was done by Millennium Challenge Corporation. Water to Market Institutional Strengthening 2007-2010 MCC-WMIS 2007-10 ARM_2007_MCC-WMIS_v01_M Mathematica Policy Research, Inc. Copyright 2012, Millennium Challenge Corporation. NADA Millennium Challenge Corporation Monitoring & Evaluation Division of the Millennium Challenge Corporation Independent Performance Evaluation Edited clean data for internal use only Agriculture & Rural Development Water The Water to Market Activity is divided into two subactivities, the Improved Profitability of Water User Association Members Subactivity and the Institutional Strengthening Subactivity. The Institutional Strengthening Subactivity (ISSA) provided general technical support to water user associations (WUAs), the regional organizations that manage the distribution of and payment for irrigation water in Armenia. ISSA also provided assistance to three Water Supply Agencies (WSAs) that operate and maintain irrigation dams and pumping stations. The general aim of ISSA was to strengthen WUAs' and WSAs' managerial, technical, structural, and financial capacity and self-sufficiency. The intent of these improvements was to create more efficient and consistent irrigation supply for WUA members. ISSA also included an irrigation policy reform component, in which a reform strategy was developed through a participatory process with stakeholders such as WUA and government officials. The WtM impact evaluation originally focused on WtM training, using a random assignment design to evaluate this WtM component. Initially, evaluations of the other three WtM components were not planned. However, MCC subsequently decided to conduct analyses of the effects of the other components to the extent possible using existing quantitative data sources. Although the analyses of WtM credit, ISSA, and PPM have important limitations, these additional analyses can still help document these components' implementation and provide suggestive evidence of whether they generated their intended effects. For each of the four components of the WtM Activity, we examine the following two broad sets of questions: 1. How was the component implemented? What were the characteristics of each component's participants, and how were these participants identified and recruited? What assistance was provided to participants through the component? 2. What were the impacts of the component? What were the impacts on practices or use of new technologies as a result of the component? What were the impacts on key outcomes such as household income and poverty? We used a combination of quantitative and qualitative data to answer these research questions. ISSA Evaluation Approach For the ISSA evaluation, two data sources were used: (1) the Water User Association Administrative Survey and (2) the Water User Survey to compare WUA and water-user outcomes before ISSA to analogous outcomes after ISSA. This before-after design does not allow us to isolate the effect of ISSA from other factors that could have influenced WUAs' and water users' outcomes over this same time period, but it was the only viable option given the absence of a comparison group for the 44 WUAs assisted under the project. Armenia Rural areas in the 10 Armenian marzes excepting Yerevan. Households, administrative data Water User Surveys were conducted among households in the geographic service area of WUAs served by ISSA and covered the following domains: WUA membership and contracts, dispute resolution among water users, irrigation service fee collection, and WUA representative elections. WUA Administration Surveys were conducted among all 44 WUAs and covered the following domains: WUA profile and basic characteristics, infrastructure and technical capacity, human resource capacity and wages, office space/equipment/maintenance of information, water intake, water delivery, water losses, energy consumption, financial characteristics, institutional arrangements, relationship with members and government Administrative records data [adm] AVAG Solutions Water User Survey: The total number of surveyed households in 2009 was 1,420 (480 for targeted WUAs and 940 for non-targeted WUAs), and the 2010 and 2011 surveys featured (or will feature) a similar number of surveys for targeted versus non-targeted WUAs. Under the survey's methodology, all targeted WUAs were surveyed in both 2009 and 2010, but only a sub-sample of non-targeted WUAs was surveyed in both 2009 and 2010. Water User Association Administrative Survey: The WUA Administrative Survey collected administrative information from all 44 Water User Associations. Other [oth] Water User Survey: The total number of surveyed households in 2009 was 1,420 (480 for targeted WUAs and 940 for non-targeted WUAs), and the 2010 and 2011 surveys featured (or will feature) a similar number of surveys for targeted versus non-targeted WUAs. Under the survey's methodology, all targeted WUAs were surveyed in both 2009 and 2010, but only a sub-sample of non-targeted WUAs was surveyed in both 2009 and 2010. Water User Association Administrative Survey: The WUA Administrative Survey collected administrative information from all 44 Water User Associations. Water User Survey: Water User Surveys were conducted by AVAG Solutions in 2009 and 2010 among households in the geographic service area of WUAs served by ISSA and covered the following domains: WUA membership and contracts, dispute resolution among water users, irrigation service fee collection, and WUA representative elections. The total number of surveyed households in 2009 and 2010 was 1,420 (480 for the 8 targeted WUAs and 940 for 36 non-targeted WUAs). Although the same households were not surveyed in 2009 and 2010, the same number of households in each community were surveyed in both years. WUA Administrative Survey: Collected by AVAG Solutions for the 2007, 2008, 2009, and 2010 fiscal years, WUA administrative data provided annual estimates of service fee collection rates, WUA income and expenditures, and other important performance metrics. The survey was administered through gathering information from the State Water Committee of the Ministry of Territorial Administration of the Republic of Armenia, as well as through direct contact with the WUAs. Millennium Challenge Corporation Millennium Challenge Corporation http://data.mcc.gov/evaluations/index.php/catalog/70 Cost: None Fortson, Kenneth, Anu Rangarajan, et al. Mathematica Policy Research. Evaluation of the Water-to-Market Activity in Armenia. 2013. The user of the data acknowledges that the original collector of the data, the authorized distributor of the data, and the relevant funding agency bear no responsibility for use of the data or for interpretations or inferences based upon such uses.