Annex 2. Summary of common data-collection methods/sources used in UNDP evaluations41 METHOD/SOURCE
DESCRIPTION
ADVANTAGES
CHALLENGES
UNDP monitoring systems
Uses performance indicators to measure progress, particularly actual results against expected results
▪ Can be a reliable, cost-efficient, objective method to assess progress of outputs and outcomes
▪ Dependent upon viable monitoring systems that have established baseline indicators and targets and have collected reliable data in relation to targets over time, as well as data relating to outcome indicators
Reports and documents
Existing documentation, including quantitative and descriptive information about the initiative, its outputs and outcomes, such as documentation from capacity development activities, donor reports and other evidentiary evidence
▪ Cost-efficient
▪ Documentary evidence can be difficult to code and analyse in response to questions ▪ Difficult to verify reliability and validity of data
Questionnaires
Provides a standardized approach to obtaining information on a wide range of topics from a large number or diversity of stakeholders (usually employing sampling techniques) to obtain information on their attitudes, beliefs, opinions, perceptions, level of satisfaction, etc. concerning the operations, inputs, outputs, and contextual factors of a UNDP initiative Solicit person-to-person responses to predetermined questions designed to obtain indepth information about a person’s impressions or experiences, or to learn more
▪ Good for gathering descriptive data on a wide range of topics quickly at relatively low cost ▪ Easy to analyse ▪ Gives anonymity to respondents
▪ Self-reporting may lead to biased reporting ▪ Data may provide a general picture but may lack depth ▪ May not provide adequate information on context ▪ Subject to sampling bias
▪ Facilitates fuller coverage, range, and depth of information of a topic
▪ Can be time-consuming ▪ Can be difficult to analyse ▪ Can be costly
Interviews
41
Methods described are illustrative and not exhaustive of the types of methods applicable to the UNDP evaluation context.
50
