Escolar Documentos
Profissional Documentos
Cultura Documentos
Definitions of Impact Assessment Impact assessment describes an assessment of the longer term and sustainable changes that are planned to occur from development interventions. The term is relatively new to the development community but has The clarifies the difference between outputs, outcomes and impact. beendiagram in use inbelow environmental impact and social impact assessment for many years. Impact (Fowler, 1997). assessment has Point of MeasurementWhat isevaluation MeasuredIndicators often been confused with the of a projects or programmes immediate OutputsEffortImplementation of activities objectives. OutcomesEffectivenessUse of outputs and sustained production of benefits ImpactChangeDifference from the original problem situation
2. The Complexity of Impact Assessment There are three main difficulties in relation to the development of an appropriate
methodology for impact assessment: Firstly, there is often confusion between the evaluation of a project or programmes objectives and an assessment of its long-term impact. An OECD/DAC study tools on impact (Kruse et al, 1997) concluded there was a lack of in Secondly, evaluation and methodologies are often poorlythat developed. This results firm and reliable weaknesses in the chain of evidence from data collection through to analysis and evidence on the impact of NGO development projects and programmes, related to the conclusions. paucity of data andof assessing impact qualitatively is very complex. Thirdly, the issue weakness of evaluation methodologies. Often project evaluations consisted of descriptions of activities carried out rather than any analysis of the relevance of what had been done. This was partly due to a lack of appropriate evaluation and assessment methodologies. A further reason was that The essential starting point in developing a methodology for assessing impact is the need to insufficient attention take a primarily had been paid to the development and use of appropriate monitoring processes and qualitative procedures.perspective. This was It is therefore important to draw a clear distinction between a qualitative and a by the fact that many projects evolve and change over time. Whist this is often compounded quantitative approach. Firestones definition (left) is helpful not a negative Qualitative research attempts tobecause it shows that the scope of an assessment defines factor per se, it made tracking a projects progress and impact almost impossible when the coupled with persuade through rich systems. depiction andmethodologies to be used, application and to the insufficient monitoring The DAC Study concluded that their it was very difficult amount make anof assessment strategic comparison across cases,time to the reports assessment. of impact because having reviewed manygiven evaluation there Where was the project or programme There was not a clear chain a)thereby Face validityAre wethe measuring what we assessed think we is are measuring? overcoming abstractionbeing very large, clearly a very weak link between the information gathered and theit is not necessary to b) BiasIs there a tendency to make errors in one direction? assess all of evidence (Yin 1989). c)inherent Convergent validity Is the information gained through one method by that in quantitative studiesareas of the work but enough to gainvalidated a clear picture. conclusions drawn. gained through (Firestone 1987). another method? The scope of a specific assessment visit needs to be such that d) Internal validityAre the results this group? it will enable the assessment to begenuine reliable,for valid and credible. Validity and credibility are e) External validityAre the results applicable to other situations? taken to mean are the results believable? There are different understandings of how to assess validity. 2 For example Cohen and Manion (1989) take a very positivistic stance and see validity as follows: