P. 1
Tools and Techniques of Data Collection_First year presentation

Tools and Techniques of Data Collection_First year presentation

|Views: 451|Likes:
Publicado porDrAridita Datta

More info:

Published by: DrAridita Datta on Mar 29, 2011
Direitos Autorais:Attribution Non-commercial


Read on Scribd mobile: iPhone, iPad and Android.
download as PPTX, PDF, TXT or read online from Scribd
See more
See less








Shilpi Mishra Sharma, PGDHM 14th Bathch, 2010, IIHMR, Jaipur

Quantitative Qualitative

Distinction Between Qualitative and Quantitative Research Methods

Qualitative Methods

Quantitative Methods

Provide depth of understanding Ask why?

Measure level of confidence Ask "How many ?" "How often ?³

Study motivations/intentions/reasons Study action/manifested behaviour Are subjective Enable discovery Are exploratory Allow insight into behaviour trends and so on Interpret Are objective Provide proof Are definite Measure level of actions, trends and so on Describe

QUALITATIVE DATA COLLECTION TECHNIQUES Focus Group Discussions Participant Observation Key Informant Interviews Case Studies Projective Techniques .

PARTICIPATORY RAPID TECHNIQUES Mapping. Body Mapping. Participatory Mapping Seasonal Calendar Venn/Institutional Diagram Pie Chart/ Histogram Daily Routine Diagram Flow/causal Diagram Time Trends . Social Mapping.

Questionnaire/ Interview Schedule .QUANTITATIVE METHODS Methods of Survey/ information collection Tool .

More useful in sensitive issues Disadvantage .Dropout or non-response is much higher .METHODS OF SURVEY/ INFORMATION COLLECTION Self Administered Postal y Electronic y Advantage .

. Survey participants can choose to remain anonymous. It is not labour intensive.POSTAL This method has a low cost.SELF ADMINISTERED .

as opposed to the limits of paper or telephones. Questionnaires can be conducted swiftly. . Survey participants can choose to remain anonymous. It is not labour intensive. This method works well if your survey contains several branching questions. and on most surveys costs nothing for the participants and little for the surveyors. Sample may "self select" and thus not be representative of the population.SELF ADMINISTERED .ELECTRONIC This method has a low cost. Questions can be more detailed.


. y For example .e. and individuals who have recently moved to the area because none of these people will be in the book.if you select the phone numbers from a phone book. those who requested an unpublished phone number.INTERVIEW . Rapport with respondents High response rate Be careful that your sampling frame (i. where you get the phone numbers from) doesn't skew your sample. you are necessarily excluding people who only have a mobile phone..TELEPHONE Questionnaires can be conducted swiftly.

PERSONALLY ADMINISTERED ² FACE TO FACE INTERVIEW Questions can be more detailed. as opposed to the limits of paper or telephones. a statistical) sample so you cannot generalize your results. Rapport with respondents High response rate Usually a convenience (vs. .

TYPES OF INTERVIEWS Highly Structured Open Ended The in-depth interview .

This avoids asking questions of people that do not apply to them .A question that is answered only if the respondent gives a particular response to a previous question.TYPES OF QUESTIONS Contingency questions .

with 10 being the most preferred appearance).The respondent answers with a ´yesµ or a ´noµ. and rank-order scale y . y Scaled questions .Respondents· answers are limited to a fixed set of responses. semantic differential scale.The respondent has several option from which to choose. Most scales are closed ended. Examples of types of scales include the Likert scale.TYPES OF QUESTIONS Closed ended questions . y Multiple choice . Other types of closed ended questions include: Yes/no questions .Responses are graded on a continuum (example : rate the appearance of the product on a scale from 1 to 10.

ADVANTAGES OF CLOSED ENDED QUESTIONS Time saving Easy comparison of responses of different groups y Same group over different period of time y .

RISK OF CLOSED QUESTIONS Possible answers might be disclosed to the respondents ² might introduce bias .

EXAMPLES OF CLOSED-ENDED QUESTIONS Do you get along with your supervisor? Is that a photograph of your children? Are you leaving right at 5:00 today? Are you awake? .

Respondents fill in an empty conversation balloon.Respondents complete an incomplete story. Examples of types of open ended questions include: y y y y y y Completely unstructured . Thematic apperception test . For example. The respondent supplies their own answer without being constrained by a fixed set of possible responses. ´The most important consideration in my decision to buy a new house is . Picture completion . .µ Story completion . .Respondents complete an incomplete sentence.No options or predefined categories are suggested.TYPES OF QUESTIONS Open ended questions .Respondents explain a picture or make up a story about what they think is happening in the picture . Sentence completion .For example.Words are presented and the respondent mentions the first word that comes to mind. ´What is your opinion of questionnaires?µ Word association .

ADVANTAGES OF COMPLETELY OPEN ENDED QUESTIONS Allows to probe more deeply New issues might be explored Information provided might be useful as an example Possibility of different interpretations .

RISK OF OPEN ENDED QUESTIONS Focus might be loosed Less information might be collected Analysis ² time consuming .

PARTIALLY CATEGORIZED QUESTIONS If one has ´othersµ category Advantages Quick recoding of answers y Easy analysis y Risks y y y y y Loss of a lot of interesting and valuable information Interviews might try to get the response from the categories Interviewer might only receive one answer Interviewer might introduce the possible answer Very little space provided for recording the response .

What is the purpose of government? Why did you choose that answer? .EXAMPLES OF OPEN-ENDED QUESTIONS Tell me about your relationship with your supervisor. How do you see your future? Tell me about the children in this photograph.

Then in the second stage you ask all the product specific questions. Questions should flow from factual and behavioural questions to attitudinal and opinion questions. Questions should flow from the more general to the more specific. initial questions should be screening and rapport questions. Questions should flow from the least sensitive to the most sensitive. The researcher must ensure that the answer to a question is not influenced by previous questions. Questions should flow from unaided to aided questions. According to the three stage theory (also called the sandwich theory).QUESTION SEQUENCE Questions should flow logically from one to the next. In the last stage you ask demographic questions .

ART OF ASKING QUESTIONS Opening Remarks Establishing Rapport Neutrality of Interviewers Closing the interview General guidelines about interview .

y The research objectives and frame of reference should be defined beforehand. intrusion and privacy. the results won't influence your decision or you can't afford to implement the findings or the cost of the research outweighs its usefulness.QUESTIONNAIRE CONSTRUCTION ISSUES Knowing about how (and whether) one will use the results of research before one start. budget. y for example. including the questionnaire's context of time. manpower. then save your time and money. . don't bother doing the research.

feelings. be it preferences (of products or services). Unneeded questions are an expense to the researcher . facts. or standards of action. beliefs. descriptions of past behavior.QUESTIONNAIRE CONSTRUCTION ISSUES The nature of the expected responses should be defined and retained for interpretation of the responses.

The level of measurement ² Important for Analysis The types of questions (closed. y The type of scale or index to be used shall be determined. . open) should fit the statistical data analysis techniques available and your goals. y Respondents should have enough information or expertise to answer the questions truthfully. multiple-choice. Their background may affect their interpretation of the questions.QUESTIONNAIRE CONSTRUCTION ISSUES The topics should fit the respondents· frame of reference.

A biased question or questionnaire encourages respondents to answer one way rather than another. Even questions without bias may leave respondents with expectations. The wording should be kept simple: no technical or specialized words. The meaning should be clear. Double negatives should be reworded as positives. equivocal sentence structures and negatives may cause misunderstanding. .QUESTIONNAIRE CONSTRUCTION ISSUES Questions and prepared responses to choose from should be neutral as to intended outcome. Prior previous questions may bias later questions. The order or ´naturalµ grouping of questions is often relevant. possibly invalidating questionnaire results. Ambiguous words.

.there may be need for separate questions on marital status and living situation. y One might include ´otherµ specify---------------- The possible responses should also be mutually exclusive. y for example in both the ´marriedµ category and the ´singleµ category .QUESTIONNAIRE CONSTRUCTION ISSUES Care should be taken to ask one question at a time. The list of possible responses should be collectively exhaustive.

QUESTIONNAIRE CONSTRUCTION ISSUES Conversational writing style Sequencing of the questions Correct skipping pattern .

detailed instructions for the interviewers .QUESTIONNAIRE CONSTRUCTION ISSUES Presentation of the questions on the page (or computer screen) and use of white space. pictures. Numbering of questions may be helpful. charts. Clear. colors. or other graphics may affect respondent's interest or distract from the questions.

When one meets people for the first time we try to build up a picture of them: we develop impressions of their friendliness.SCALING TECHNIQUES The basic principle of scaling is a part of everyday life. . These impressions rarely rely on one piece of information but are a composite picture based on a number of clues. trustworthiness and so forth. intelligence.

SCALING TECHNIQUES Differential Scales Summated Scales y Likert Scale .

(5) strongly disapprove. (1) strongly approve. . most scales currently used in social science research are Likert-type scales. (3) undecided. In fact. In such a scale. the respondents are asked to respond to each item in terms of several degrees of agreement or disagreement: for example. (2) approve.LIKERT SCALE scale most frequently used in the study of attitudes follows the pattern devised by Rensis Likert (1932) and is referred to as a Likert type scale. (4) disapprove.

Rating the Items. The next step is to have a group of judges rate the items. Usually you would use a 1-to-5 rating scale where: = strongly unfavorable to the concept = somewhat unfavorable to the concept = undecided = somewhat favorable to the concept = strongly favorable to the concept .

I am confident that I can handle my job without constant assistance. 6. I know how to handle it. I am proud of my ability to cope with difficulties at work. I feel good about my work on the job. . INSTRUCTIONS: Please rate how strongly you agree or disagree with each of the following statements by placing a check mark in the appropriate box.Example: The Employment Self Esteem Scale Here's an example of a ten-item Likert Scale that attempts to estimate the level of self esteem a person has on the job. 4. Strongly Disagree Strongly Disagree Strongly Disagree Strongly Disagree Strongly Disagree Strongly Disagree Strongly Disagree Strongly Disagree Strongly Disagree Strongly Disagree Somewhat Disagree Somewhat Disagree Somewhat Disagree Somewhat Disagree Somewhat Disagree Somewhat Disagree Somewhat Disagree Somewhat Disagree Somewhat Disagree Somewhat Disagree Somewhat Agree Somewhat Agree Somewhat Agree Somewhat Agree Somewhat Agree Somewhat Agree Somewhat Agree Somewhat Agree Somewhat Agree Somewhat Agree Strongly Agree Strongly Agree Strongly Agree Strongly Agree Strongly Agree Strongly Agree Strongly Agree Strongly Agree Strongly Agree Strongly Agree 1. 8. I know I'll be able to cope with work for as long as I want. Notice that this instrument has no center or neutral point -. 3. When I feel uncomfortable at work.the respondent has to declare whether he/she is in agreement or disagreement with the item. 9. 2. 10. I can tell that my coworkers respect me. 7. I get along well with others at work. On the whole. I feel like I make a useful contribution at work. I am proud of my relationship with my supervisor at work. I can tell that other people at work are glad to have me there. 5.


FGDs are not used to test hypotheses or to produce research findings that can be generalized . during which group members talk freely and spontaneously about a certain topic.FOCUS GROUP DISCUSSION (FGD) A Focus Group Discussion (FGD) is a group discussion of 6-12 persons guided by a facilitator.

reasons for low women's participation in development programme can be understood by a focus group discussion among women. 4.To generate new ideas. A group works best to build on the ideas generated.To focus research and develop relevant research hypotheses by exploring in greater depth the problem to be investigated and its possible causes. attitudes. For example.To explore controversial topics.To supplement information on community knowledge.PURPOSE OF FGD 1. 2. 3.To develop appropriate messages for the education programme. beliefs. 6. . and behaviour already available but are incomplete or unclear. largescale surveys.To formulate appropriate questions for more structured. 5.

Key Features of the FGD Purpose  Research definition and  refinement Development of hypotheses Generation of vocabularies Formulation of questions for interview schedules Provision of supplementary information on community beliefs. time and place determined in advance  Process Discussion guidelines need to be pre-tested More than one focus group must be held Moderator and notetaker require training         . perceptions and attitudes  Composition Advance selection by random sampling or alternative criteria Homogeneous with respect to major social divisions Anonymity of participants Preferred Day.

time (start and finish) and place held Number and description of participants Major issues covered in focus group Group dynamics. date. Community. encourages active participation  Keeps conversation flowing. including Speaker identity . tape recorded with supplementary notes Speak clearly.Participant Guidelines  Focus group runs 90 minutes. including non. one at a time Want everyone's opinion .verbal interaction Discussion details. Maintaining focus but allowing  for flexibility Role of Notetaker/Recorder Maintains a written record of the focus group.no right/wrong answers Role of Facilitator/Moderator  Facilitates but does not  dominate discussion Introduces new issues for discussion Monitors participant involvement and  interaction.supplements tape Back-up to moderator       Courage of conviction   . including.

SPECIFIC COMPONENTS OF FGD Preparation Recruitment of Participants y Physical Arrangements y Preparation of FGD Guideline y Conducting the session Moderator's Functions y Recorder's Functions y Number and Duration of Sessions .

y .SPECIFIC COMPONENTS OF FOCUS GROUP ORGANIZATIONS Methodological Issues Appear to reduce the chance of questions being misunderstood by respondents. y A major concern is the validity of conclusions from the focus group session. and to reduce sociallydesirable answers y The informal atmosphere of the group also should encourage participants to express views frankly and freely y chances of introducing error in focus group research is particularly high in cases where the interview is conducted in the indigenous language and then translated. where quality of data is so dependent on the moderator whose individual skills are central to the quality and quantity of the data obtained.

4. PO reduces the problem of reactivity among respondents. 5. Involves establishing rapport in a new community There are five reasons as to why Participant Observation (PO) should be insisted upon in the conduct of a scientific research about cultural group: PO is not a method of collecting just qualitative data. PO helps you formulate sensible questions in the native language. In fact. 3. .PARTICIPANT OBSERVATION 1. Lower reactivity means higher validity of data. It is a Strategy. both quantitative and qualitative. and allows you to speak with confidence about the meaning of data. Many research problems cannot be addressed adequately by anything except PO. which facilitates data collection in the field all kinds of data. 2. it is not really a method at all. PO gives you intuitive understanding of what is going on in a culture.

3. learning the native language Building explicit awareness Building memory Maintaining naivete Building writing skills 2. . 4. 5.IMPORTANT SKILLS REQUIRED TO BECOME AN EFFICIENT PARTICIPANT OBSERVER 1.

Non participant observation: The observer does not actively participate in the group activities but observes the group from a distance and the observer is fully aware that he/she is entirely apart from the object of observation. This type of observation needs to be supplemented by structured observation or schedules of information (see Goode & Hatt. organising and directing the normal activities /surroundings by any internal force. 1952) . Non-controlled observation: The observation is done without managing. it is called noncontrolled observation.

KEY INFORMANTS (KI) INTERVIEW An important qualitative method. particularly in areas where the entry has not yet been made .

y trustworthy and y should have other personal attributes conducive to conducting detailed interviews. y articulate. .ESSENTIAL FEATURES OF KI INTERVIEWS Selection of KI KI should. y willing to participate. y Has unique position in the community Conducting Interviews y The interview should be characterized by Silent Probe Phased assertion.

`the social microscopes' (Young.CASE STUDIES A fairly exhaustive study of a person or group is called a life or case history or case study. precise detail. 1973) A case study explores the social process while statistical technique reveals the extent & degree of association . Burgess termed the case study method. It deepens our perception & give us clear insight into life. Because of its aid in studying behaviour in specific.

The social situation must be studied to understand the degree of social pressures. social participation exercised by the subject .THE MAJOR CRITERIA FOR LIFE HISTORY STUDY Behaviour of an individual must be viewed as a response to definite social stimulations. The continuous related character of experience from childhood through adulthood should be stressed. The subject (he/she) must be viewed as a member of a cultural group/community.

an individual supplies structure to unstructured stimuli in a manner consistent with the individual·s own unique pattern of conscious and unconscious needs.PROJECTIVE TECHNIQUE In a projective test. impulses. and ways of perceiving and responding Projective methods were initially used by psychologists and psychiatrists for the diagnosis and treatment of emotionally disordered patients . desires. fears. conflicts.

µ Subjects are unaware of what they disclose. Projection is greater to stimulus material that is similar to the examinee. the more examinees reveal about their personality.ASSUMPTIONS The more ambiguous the stimuli. . Every response provides meaning for personality analysis. There is an ´unconscious.

researchers thus can identify gaps that could be addressed through interventions.EXAMPLE . . This method is useful to study people·s perceptions about human physiology. It is a comfortable means of expression for those respondents who feel shy to speak about reproduction and sexuality. 2002). In this method respondents are asked to sketch reproductive organs or to label body parts and explain the functions. reproductive health issues.BODY MAPPING It is a projective technique in which respondents draw maps of human body (see Ulinetal.

IMPORTANCE OF COMBINING DIFFERENT DATA COLLECTION TECHNIQUES Mix of Quantitative and Qualitative Research Techniques Reduction in chances of bias More comprehensive understaing of study topic .

BIAS IN INFORMATION COLLECTION Defective Instruments Observers Bias Effect of the interview on thr informant Information Bias y These affect the validity and Reliability of the study .

It can also be used to familiarise interviewers with the questionnaire or schedule. y . y questionnaire format and y Interview process. y the language.PRETESTING AND PILOT STUDIES Pre-test helps in evaluating the different questions.

The questionnaire is checked for clarity and understanding and the prospective respondents are informed about the same. After this is established, interviewer can ask the respondent what came to his mind when the question was put forward. Respondent's answer helps the researcher in understanding whether the question evokes what it was supposed to evoke or not. If it does not, then the wording of the question ought to change. In this way, confusing words and phrases can be avoided.


When a respondent hesitates to answer or is unable to understand a question, additional questions intended to overcome hesitancy or misunderstanding help in modifying the questionnaire. The researcher who developed the questionnaire should himself/herself conduct some of the pre-test interviews as it helps in evaluating the responses and determining whether changes should be made or not. Pre-testing should also be conducted in a population, which is very similar to the study population. Twenty-five to fifty pre-test interviews are usually sufficient to check the quality of the questionnaire. However, their number depends upon the purpose and availability of time and money. If pre-test is used for training the interviewers, then more interviews, can be conducted. The data obtained from the pre-test are not to be included in the final study.

PILOT SURVEY A series of small pre-tests can be conducted on the isolated problems of the design, and after establishing a broad plan of enquiry, it may take the form of a pilot survey, "a small replica of the main survey - a dress rehearsal". - Moser and Kalton

Finding variability within the population. . One can also evaluate the strain on and efficiency of interviewers. adequacy. Estimating the non-response rates : Through pilot surveys one can estimate the refusal and non-contact rate and accordingly decide upon the appropriate technique of data collection. a bigger sample would be required. which is important to know for determining the sample design and size : If the variability is more. up-todateness and convenience in obtaining such records. but if the variability is not much. even a smaller sample will be adequate.THE IMPORTANCE OF PRE-TESTS AND PILOT SURVEYS LIES IN Determining the adequacy of the for a study sampling frame : High hospital records are to be used. pre-test may be done to see their completeness.

Through pilot surveys one may also get some idea of the estimated cost of the main survey and consider the areas where economies can be made : Pilot surveys not only help in improving upon the questionnaire. their placement. and efficiency of the field organisation staff : Pre-tests and pilot surveys are effective instruments in checking whether the interviewers are able to follow the instructions properly or they misunderstand something. a heavy concentration of responses at one extreme may be indicative of a leading question. which has suggested some stereotyped answers.THE IMPORTANCE OF PRE-TESTS AND PILOT SURVEYS LIES IN To determine the usefulness of questionnaire : The adequacy of questions. If the questions are unable to convey what they are intended to. time and money. clarity of definitions and use of technical terms. codes chosen for pre-coded questions. Similarly. whether the codes allocated for different answers are adequate or not or is there a need to convert an open question to a structured question or vice-versa. a large number of `don't know' replies suggests a vague question. language. The difficulties encountered during pilot surveys and pre-tests help in improving the questionnaire for the main study. unambiguity of words. The size and design of pilot survey is a matter of convenience. For example. but also give an insight in to the researcher whether there is really a need to carry out the main survey or not. there is a need to make the necessary changes. If a large number of people refuse to answer a particular question. . probably there is a need to remove it or change its language or place. To determine the adequacy of instructions to the interviewers.

THE VALIDITY OF MEASUREMENT/ TOOL Basic questions must be asked about any measuring instrument What does it measure? y Are the data it provides relevant to the characteristic in which one is interested? y Do the differences in scores represent the differences on the characteristic one is trying to measure. or do they reflect also the influence of other factors? y .

WAYS TO EVALUATE THE VALIDITY OF THE INSTRUMENT Face Validity Concurrent Validity Predictive Validity Construct Validity .

FACE VALIDITY Face validity is evaluated by a group of judges. Every instrument must pass the face validity test either formally or informally. Evaluating the face validity is a subjective process. Without such minimal face validity. but we could calculate the validity figures by computing the amount of agreement between judges. Every researcher who chooses an instrument is a judge who has decided that the test measures the concept he or she wishes to study. who read or look at a measuring technique and decide whether in their opinion it measures what its name suggests. an instrument would not be used. sometimes experts. the higher the face validity. The higher the percent who says it measures what it claims to measure. .

If the test failed to discriminate between the two groups. to be active in religious activities and otherwise to give evidence of high religiosity. it could not be considered to measure religiosity with validity. Thus. .CONCURRENT VALIDITY Concurrent validity is the ability of a measuring instrument to distinguish between individuals who are known to differ. if a scale were being devised for the purpose of measuring religiosity. T hese answers would then be compared with those from a group known not to be very religious and also known to oppose religious behaviour in other ways. the questions could be tested by administering them to one group known to be religious.

PREDICTIVE VALIDITY Predictive validity is the ability of a measuring instrument to identify future differences. Predictive validity is an evaluation of a measure's practical worth in foreseeing the future. the predictive validity of a scale measuring attitude towards birth control is the ability of the scale to identify who will eventually adopt contraception and who will not practise contraception. For instance. .

. that it is distinct from other constructs. Unlike face validity. construct validity requires more than expert opinion. It requires a demonstration that the construct in question exists. and that the instrument measures that particular construct and no other.CONSTRUCT VALIDITY Construct validity is an evaluation of the extent to which an instrument measures the theoretical construct the investigator wishes to measure.

they will yield the same results to the extent that the measurements are free from random or variable errors. When independent and comparable measures of the same thing are obtained. but a variety of constant and random errors. The reliability of a measuring instrument should be determined before it is used in a study . The evaluation of the reliability of any measurement procedure consists of determining how much of the variation in scores among individuals is due to inconsistencies in measurement. which the instrument is attempting to measure.THE RELIABILITY OF MEASUREMENT /INSTRUMENT scores on measuring instruments usually reflect not only the characteristics.

You're Reading a Free Preview

/*********** DO NOT ALTER ANYTHING BELOW THIS LINE ! ************/ var s_code=s.t();if(s_code)document.write(s_code)//-->