Although evaluations are often retrospective, their purpose is essentially forward looking. Develop Initial Implementation Monitoring Questions, Step 8. Global data and statistics, research and publications, and topics in poverty and development. Administrative data can require some upfront work to be utilizedfor example, any survey data collected must contain some indicator that links to the administrative data. Monitoring and Evaluation (M&E) is a combined term for the processes set up by organizations such as companies, government agencies, international organisations and NGOs, with the goal of improving their management of outputs, outcomes and impact. The second sub-system should be formed by specific indicators pertaining to the activities undertaken and their expected results. 7c. [1] Evaluation involves the examination of the relevance, effectiveness, efficiency and impact of activities in the light of specified objectives.[2]. Assessment, monitoring and evaluation are used at different stages during a humanitarian response and are closely linked to public-health decision-making and the implementation of RH programme activities. Tax calculation will be finalised at checkout, Faculty of Business and Technology, Stamford International University, Bangkok, Thailand, You can also search for this author in This practical guide helps readers understand and use the steps that program planners and evaluators take in implementing and monitoring a new program, policy, or practice in an organizational setting. The detection capability of the International Monitoring System (IMS) infrasound network is a key concern since ubiquitous coherent noise interfere with the ide. This practical guide helps readers understand and use the steps that program planners and evaluators take in implementing and monitoring a new program, policy, or practice in an organizational setting. The credibility and objectivity of monitoring and evaluation reports depend very much on the independence of the evaluators. Researchers face a choice when selecting who should conduct monitoring. Researchers should monitor the implementation of a program to preserve its integrity of the program and collect additional information that can inform the generalizability of the results of the program. For assistance with your order: Please email us at [email protected] or connect with your SAGE representative. against your goals to ensure you're on the right track. This title is also available on SAGE Research Methods, the ultimate digital methods library. Regular reporting should be accompanied by supervision, either using existing structures or by undertaking joint visits (by WASH and NTD programme managers). This could influence respondents to misreport their true food consumption. Adding survey questions to planned survey rounds, such as the midline or endline surveys, can provide information on compliance, spillovers, and take up for ex-post analysis. https://doi.org/10.1007/978-981-16-7755-7_9, DOI: https://doi.org/10.1007/978-981-16-7755-7_9, eBook Packages: Business and ManagementBusiness and Management (R0). Collect and Manage Implementation Data, Phase V. A nalysis/Synthesis, Reporting, and Use, Step 11. Washington, November 16th, 1998. Rate per mile. February 2014. Periodic reflectionReflection should be part of your monitoring and evaluation plan, so you can regularly respond to questions such as: To do this, it may be useful to convene a small group and together go back to the problem analysis conducted during the planning phase problem analysis approaches tool. Information on access to water and sanitation services is often collected at various administrative levels, so rather than collecting new information, you can arrange for this information to be shared. Focus group discussions should function in tandem with the other methods of monitoring. In particular, a better understanding of the benefits of a good process evaluation in addition to the more obvious outcome measures is something that is important. Resources needed to carry out activities and outputs. United Nations development programme evaluation office - Handbook on Monitoring and Evaluating for Results. The evaluation seeks to answer: Keep in mind that disease control programmes tend to focus on epidemiological impact evaluation using impact surveys. The delivery method of high-frequency monitoring also can limit the type of questions asked; if sent via text message, respondents may be constrained to entering only numbers or short text responses (in contrast to in-person or surveys via phone call, where longer responses and additional types of data can be collected, such as photos or audio recordings). Special attention should be paid to the timely execution of monitoring activities. Any policy, practice, service or programme that is being implemented. Prince Conway II; a M&E specialist from the Ministry of Health and Social Welfare was one of the those who achieved greatly in the health sector moving the Malaria data from 60% below base line to 85% above target. Accessed February 24, 2021. doi:10.1086/659655. They can also be useful for documenting issues that will inform ex-post analysis. If observer effects occur in the comparison group, they are known as John Henry effects, in reference to an American folklore tale (Duflo et al., 2007). The WHO: What means/resources/inputs (human, technical, infrastructural) are required; What potential problems could affect success; How progress and achievements will be measured and verified. Where there are differences, they need to be explained and agreed on by the local population. . Monitoring and evaluation plays a key part in ensuring good programme results. If indicators are well designed and consistently monitored, stakeholders can be kept abreast of the development of the program, and participatory evaluation techniques can be utilized to gauge the results obtained during each stage of implementation, to correct shortcomings in its operating strategy and to adapt the program to changes in the circumstances in which it operates. Its primary purpose is to support any person, team or organisation introducing or seeking to change whether they are policymakers, service providers, practitioners or researchers. Due to their delivery method, mobile phone surveys should consist of a relatively small number of questions on important concepts. How can we increase access to and delivery of quality health care services and effectively promote healthy behaviors? So, you can see how such a system that focuses on a methodical, well-thought-out approach to . These indicators would be measured on the basis of the internal documentation of the project and through rapid on-site appraisal techniques. Browse news articles about J-PAL and our affiliated professors, read our press releases and monthly global and research newsletters, and connect with us for media inquiries. 8 . This information is used to improve both the intervention and the implementation process. These measures are then adapted to better fit local concepts. Airplane*. See, for example, the Tropical Data methodology, which incorporates WASH indicators into disease mapping surveys. The programme risk analysis template should help undertake this process. The World Bank Group works in every major area of development. It allows the user to systematically work through the connections between the components of an intervention or process, usually in graphical format on a single page. Develop or Update the Action Model, Action Plan, and Logic Model to Integrate Planning, Phase III. The spread of ideas through diffusion is generally a passive process, following an unpredictable, unprogrammed, emergent and self-organising path, e.g. Her roles in these projects, which include eight large-scale interventions, have encompassed using multi-level conceptual models to develop a comprehensive model of organizational environments, constructing scales and indexes to assess contextual factors and implementation processes, addressing challenges involved in intervention design and implementation in field-based settings, and designing and carrying comprehensive intervention implementation monitoring. Using daily photos of teachers in classrooms to monitor attendance, Using remote sensors to monitor Hawthorne effects, The view from above: applications of satellite data in economics, USAID's How-to note: planning and conducting site visits, https://www.aeaweb.org/articles?id=10.1257/jep.30.4.171, https://link.springer.com/article/10.1007/s11414-012-9275-1, Goldilocks Deep Dive: Using Administrative Data for Monitoring and Evaluation, Goldilocks Toolkit: Monitoring for Learning and Accountability. The process is iterative; research teams might need to revise the indicators they collect to match local conditions, or to respond to some external factor. This chapter highlights steps to be undertaken once the business operation is up and running. How can we increase access to energy, reduce pollution, and mitigate and build resilience to climate change? William Philip Wall . Our affiliated professors are based at 97 universities and conduct randomized evaluations around the world to design, evaluate, and improve programs and policies aimed at reducing poverty. Implementation Monitoring Planning, Step 7. A plan outlining the key activities, responsibilities, timelines and other important information required to achieve the desired outcomes from implementing an intervention. Monitoring and evaluation offer essential feedback loops to answer questions such as "Has the intervention been delivered as intended? The monitoring is a short term assessment and does not take into consideration the outcomes and impact unlike the evaluation process which also assesses the outcomes and sometime longer term impact. Describe the Program, Policy, or Practice, Organizational Setting, and Broader Context, Step 3. The template logframe tool offers a comprehensive set of indicators for your consideration. It can be related to design, implementation, results, and outcomes (cause and effect) of an intervention. - Indicators relating to changes in individual, family and community behaviours and perceptions over time, or proxy measures such as presence of hand-washing stations with soap and water Your feedback is very helpful to us as we work to improve the site functionality on worldbank.org. Despite the inherent challenges of conducting impact assessment of CDD programs, there is a growing recognition that there is a need for evidence of the actual impact of such programs and a need for insights on how to improve project performance. 1 (2011): 39-77. Ideal for practitioners, researchers, and students, this book can be used as a primary text for a process evaluation or an implementation monitoring course or as a supplemental text in a broader program evaluation course. A better understanding of the intricacies of intervention development, delivery and evaluation is an important part of many student's development. The research team distributes flyers advertising the accounts to eligible households in regions served by treatment branches, informing them of the following features of these accounts: Randomization is done at the bank level, and the sample of bank branches is chosen such that there are buffer zones in between treatment and comparison banks.