P. 1
Tools and Techniques of Data Collection_First year presentation

Tools and Techniques of Data Collection_First year presentation

|Views: 451|Likes:
Publicado porDrAridita Datta

More info:

Published by: DrAridita Datta on Mar 29, 2011
Direitos Autorais:Attribution Non-commercial


Read on Scribd mobile: iPhone, iPad and Android.
download as PPTX, PDF, TXT or read online from Scribd
See more
See less








Shilpi Mishra Sharma, PGDHM 14th Bathch, 2010, IIHMR, Jaipur

Quantitative Qualitative

Distinction Between Qualitative and Quantitative Research Methods

Qualitative Methods

Quantitative Methods

Provide depth of understanding Ask why?

Measure level of confidence Ask "How many ?" "How often ?³

Study motivations/intentions/reasons Study action/manifested behaviour Are subjective Enable discovery Are exploratory Allow insight into behaviour trends and so on Interpret Are objective Provide proof Are definite Measure level of actions, trends and so on Describe

QUALITATIVE DATA COLLECTION TECHNIQUES Focus Group Discussions Participant Observation Key Informant Interviews Case Studies Projective Techniques .

Participatory Mapping Seasonal Calendar Venn/Institutional Diagram Pie Chart/ Histogram Daily Routine Diagram Flow/causal Diagram Time Trends . Body Mapping. Social Mapping.PARTICIPATORY RAPID TECHNIQUES Mapping.

QUANTITATIVE METHODS Methods of Survey/ information collection Tool .Questionnaire/ Interview Schedule .

Dropout or non-response is much higher .More useful in sensitive issues Disadvantage .METHODS OF SURVEY/ INFORMATION COLLECTION Self Administered Postal y Electronic y Advantage .

Survey participants can choose to remain anonymous. It is not labour intensive.POSTAL This method has a low cost.SELF ADMINISTERED . .

as opposed to the limits of paper or telephones. Sample may "self select" and thus not be representative of the population.ELECTRONIC This method has a low cost. . It is not labour intensive. and on most surveys costs nothing for the participants and little for the surveyors. Questions can be more detailed. Questionnaires can be conducted swiftly. Survey participants can choose to remain anonymous. This method works well if your survey contains several branching questions.SELF ADMINISTERED .


you are necessarily excluding people who only have a mobile phone. .TELEPHONE Questionnaires can be conducted swiftly.e.. where you get the phone numbers from) doesn't skew your sample. Rapport with respondents High response rate Be careful that your sampling frame (i.INTERVIEW . and individuals who have recently moved to the area because none of these people will be in the book. those who requested an unpublished phone number. y For example .if you select the phone numbers from a phone book.

Rapport with respondents High response rate Usually a convenience (vs. as opposed to the limits of paper or telephones.PERSONALLY ADMINISTERED ² FACE TO FACE INTERVIEW Questions can be more detailed. a statistical) sample so you cannot generalize your results. .

TYPES OF INTERVIEWS Highly Structured Open Ended The in-depth interview .

This avoids asking questions of people that do not apply to them .TYPES OF QUESTIONS Contingency questions .A question that is answered only if the respondent gives a particular response to a previous question.

Responses are graded on a continuum (example : rate the appearance of the product on a scale from 1 to 10.The respondent answers with a ´yesµ or a ´noµ. with 10 being the most preferred appearance). Examples of types of scales include the Likert scale. semantic differential scale. and rank-order scale y . Most scales are closed ended. Other types of closed ended questions include: Yes/no questions .Respondents· answers are limited to a fixed set of responses.The respondent has several option from which to choose.TYPES OF QUESTIONS Closed ended questions . y Scaled questions . y Multiple choice .

ADVANTAGES OF CLOSED ENDED QUESTIONS Time saving Easy comparison of responses of different groups y Same group over different period of time y .

RISK OF CLOSED QUESTIONS Possible answers might be disclosed to the respondents ² might introduce bias .

EXAMPLES OF CLOSED-ENDED QUESTIONS Do you get along with your supervisor? Is that a photograph of your children? Are you leaving right at 5:00 today? Are you awake? .

No options or predefined categories are suggested.µ Story completion . For example. Thematic apperception test . .Respondents complete an incomplete sentence.Respondents complete an incomplete story. ´The most important consideration in my decision to buy a new house is . Examples of types of open ended questions include: y y y y y y Completely unstructured .Words are presented and the respondent mentions the first word that comes to mind.For example. Sentence completion .TYPES OF QUESTIONS Open ended questions .Respondents fill in an empty conversation balloon. Picture completion . The respondent supplies their own answer without being constrained by a fixed set of possible responses. ´What is your opinion of questionnaires?µ Word association .Respondents explain a picture or make up a story about what they think is happening in the picture . .

ADVANTAGES OF COMPLETELY OPEN ENDED QUESTIONS Allows to probe more deeply New issues might be explored Information provided might be useful as an example Possibility of different interpretations .

RISK OF OPEN ENDED QUESTIONS Focus might be loosed Less information might be collected Analysis ² time consuming .

PARTIALLY CATEGORIZED QUESTIONS If one has ´othersµ category Advantages Quick recoding of answers y Easy analysis y Risks y y y y y Loss of a lot of interesting and valuable information Interviews might try to get the response from the categories Interviewer might only receive one answer Interviewer might introduce the possible answer Very little space provided for recording the response .

How do you see your future? Tell me about the children in this photograph.EXAMPLES OF OPEN-ENDED QUESTIONS Tell me about your relationship with your supervisor. What is the purpose of government? Why did you choose that answer? .

Questions should flow from the least sensitive to the most sensitive. According to the three stage theory (also called the sandwich theory). Questions should flow from factual and behavioural questions to attitudinal and opinion questions. The researcher must ensure that the answer to a question is not influenced by previous questions.QUESTION SEQUENCE Questions should flow logically from one to the next. In the last stage you ask demographic questions . Questions should flow from the more general to the more specific. initial questions should be screening and rapport questions. Then in the second stage you ask all the product specific questions. Questions should flow from unaided to aided questions.

ART OF ASKING QUESTIONS Opening Remarks Establishing Rapport Neutrality of Interviewers Closing the interview General guidelines about interview .

y for example.QUESTIONNAIRE CONSTRUCTION ISSUES Knowing about how (and whether) one will use the results of research before one start. then save your time and money. y The research objectives and frame of reference should be defined beforehand. budget. including the questionnaire's context of time. the results won't influence your decision or you can't afford to implement the findings or the cost of the research outweighs its usefulness. . don't bother doing the research. intrusion and privacy. manpower.

QUESTIONNAIRE CONSTRUCTION ISSUES The nature of the expected responses should be defined and retained for interpretation of the responses. or standards of action. facts. beliefs. feelings. descriptions of past behavior. be it preferences (of products or services). Unneeded questions are an expense to the researcher .

. open) should fit the statistical data analysis techniques available and your goals. The level of measurement ² Important for Analysis The types of questions (closed. Their background may affect their interpretation of the questions. y Respondents should have enough information or expertise to answer the questions truthfully.QUESTIONNAIRE CONSTRUCTION ISSUES The topics should fit the respondents· frame of reference. y The type of scale or index to be used shall be determined. multiple-choice.

Prior previous questions may bias later questions. A biased question or questionnaire encourages respondents to answer one way rather than another. The wording should be kept simple: no technical or specialized words. Even questions without bias may leave respondents with expectations.QUESTIONNAIRE CONSTRUCTION ISSUES Questions and prepared responses to choose from should be neutral as to intended outcome. possibly invalidating questionnaire results. Ambiguous words. The meaning should be clear. The order or ´naturalµ grouping of questions is often relevant. . equivocal sentence structures and negatives may cause misunderstanding. Double negatives should be reworded as positives.

QUESTIONNAIRE CONSTRUCTION ISSUES Care should be taken to ask one question at a time.there may be need for separate questions on marital status and living situation. y for example in both the ´marriedµ category and the ´singleµ category . . The list of possible responses should be collectively exhaustive. y One might include ´otherµ specify---------------- The possible responses should also be mutually exclusive.

QUESTIONNAIRE CONSTRUCTION ISSUES Conversational writing style Sequencing of the questions Correct skipping pattern .

colors. charts. pictures. detailed instructions for the interviewers . Clear. Numbering of questions may be helpful. or other graphics may affect respondent's interest or distract from the questions.QUESTIONNAIRE CONSTRUCTION ISSUES Presentation of the questions on the page (or computer screen) and use of white space.

intelligence. trustworthiness and so forth.SCALING TECHNIQUES The basic principle of scaling is a part of everyday life. When one meets people for the first time we try to build up a picture of them: we develop impressions of their friendliness. These impressions rarely rely on one piece of information but are a composite picture based on a number of clues. .

SCALING TECHNIQUES Differential Scales Summated Scales y Likert Scale .

LIKERT SCALE scale most frequently used in the study of attitudes follows the pattern devised by Rensis Likert (1932) and is referred to as a Likert type scale. (4) disapprove. the respondents are asked to respond to each item in terms of several degrees of agreement or disagreement: for example. (1) strongly approve. (5) strongly disapprove. (2) approve. In fact. most scales currently used in social science research are Likert-type scales. In such a scale. (3) undecided. .

Rating the Items. Usually you would use a 1-to-5 rating scale where: = strongly unfavorable to the concept = somewhat unfavorable to the concept = undecided = somewhat favorable to the concept = strongly favorable to the concept . The next step is to have a group of judges rate the items.

I am proud of my relationship with my supervisor at work. Strongly Disagree Strongly Disagree Strongly Disagree Strongly Disagree Strongly Disagree Strongly Disagree Strongly Disagree Strongly Disagree Strongly Disagree Strongly Disagree Somewhat Disagree Somewhat Disagree Somewhat Disagree Somewhat Disagree Somewhat Disagree Somewhat Disagree Somewhat Disagree Somewhat Disagree Somewhat Disagree Somewhat Disagree Somewhat Agree Somewhat Agree Somewhat Agree Somewhat Agree Somewhat Agree Somewhat Agree Somewhat Agree Somewhat Agree Somewhat Agree Somewhat Agree Strongly Agree Strongly Agree Strongly Agree Strongly Agree Strongly Agree Strongly Agree Strongly Agree Strongly Agree Strongly Agree Strongly Agree 1. 5. 9. INSTRUCTIONS: Please rate how strongly you agree or disagree with each of the following statements by placing a check mark in the appropriate box. I am confident that I can handle my job without constant assistance. I feel like I make a useful contribution at work. . I know how to handle it.the respondent has to declare whether he/she is in agreement or disagreement with the item. I am proud of my ability to cope with difficulties at work. I feel good about my work on the job. 3. I know I'll be able to cope with work for as long as I want. I get along well with others at work. 10.Example: The Employment Self Esteem Scale Here's an example of a ten-item Likert Scale that attempts to estimate the level of self esteem a person has on the job. When I feel uncomfortable at work. 2. I can tell that my coworkers respect me. 8. 4. 6. I can tell that other people at work are glad to have me there. On the whole. 7. Notice that this instrument has no center or neutral point -.


FOCUS GROUP DISCUSSION (FGD) A Focus Group Discussion (FGD) is a group discussion of 6-12 persons guided by a facilitator. during which group members talk freely and spontaneously about a certain topic. FGDs are not used to test hypotheses or to produce research findings that can be generalized .

3. reasons for low women's participation in development programme can be understood by a focus group discussion among women. 2. beliefs.To focus research and develop relevant research hypotheses by exploring in greater depth the problem to be investigated and its possible causes.PURPOSE OF FGD 1. and behaviour already available but are incomplete or unclear. 4.To supplement information on community knowledge. A group works best to build on the ideas generated. largescale surveys. 5.To formulate appropriate questions for more structured.To explore controversial topics. attitudes. .To generate new ideas. 6. For example.To develop appropriate messages for the education programme.

time and place determined in advance  Process Discussion guidelines need to be pre-tested More than one focus group must be held Moderator and notetaker require training         . perceptions and attitudes  Composition Advance selection by random sampling or alternative criteria Homogeneous with respect to major social divisions Anonymity of participants Preferred Day.Key Features of the FGD Purpose  Research definition and  refinement Development of hypotheses Generation of vocabularies Formulation of questions for interview schedules Provision of supplementary information on community beliefs.

including. date. including Speaker identity . encourages active participation  Keeps conversation flowing. Maintaining focus but allowing  for flexibility Role of Notetaker/Recorder Maintains a written record of the focus group.no right/wrong answers Role of Facilitator/Moderator  Facilitates but does not  dominate discussion Introduces new issues for discussion Monitors participant involvement and  interaction.verbal interaction Discussion details. time (start and finish) and place held Number and description of participants Major issues covered in focus group Group dynamics.supplements tape Back-up to moderator       Courage of conviction   . one at a time Want everyone's opinion .Participant Guidelines  Focus group runs 90 minutes. Community. including non. tape recorded with supplementary notes Speak clearly.

SPECIFIC COMPONENTS OF FGD Preparation Recruitment of Participants y Physical Arrangements y Preparation of FGD Guideline y Conducting the session Moderator's Functions y Recorder's Functions y Number and Duration of Sessions .

where quality of data is so dependent on the moderator whose individual skills are central to the quality and quantity of the data obtained. y .SPECIFIC COMPONENTS OF FOCUS GROUP ORGANIZATIONS Methodological Issues Appear to reduce the chance of questions being misunderstood by respondents. and to reduce sociallydesirable answers y The informal atmosphere of the group also should encourage participants to express views frankly and freely y chances of introducing error in focus group research is particularly high in cases where the interview is conducted in the indigenous language and then translated. y A major concern is the validity of conclusions from the focus group session.

5. It is a Strategy. PO reduces the problem of reactivity among respondents. . Lower reactivity means higher validity of data.PARTICIPANT OBSERVATION 1. and allows you to speak with confidence about the meaning of data. it is not really a method at all. In fact. Many research problems cannot be addressed adequately by anything except PO. PO gives you intuitive understanding of what is going on in a culture. 4. 2. PO helps you formulate sensible questions in the native language. Involves establishing rapport in a new community There are five reasons as to why Participant Observation (PO) should be insisted upon in the conduct of a scientific research about cultural group: PO is not a method of collecting just qualitative data. which facilitates data collection in the field all kinds of data. both quantitative and qualitative. 3.

5. .IMPORTANT SKILLS REQUIRED TO BECOME AN EFFICIENT PARTICIPANT OBSERVER 1. learning the native language Building explicit awareness Building memory Maintaining naivete Building writing skills 2. 3. 4.

This type of observation needs to be supplemented by structured observation or schedules of information (see Goode & Hatt. it is called noncontrolled observation. Non participant observation: The observer does not actively participate in the group activities but observes the group from a distance and the observer is fully aware that he/she is entirely apart from the object of observation. Non-controlled observation: The observation is done without managing. organising and directing the normal activities /surroundings by any internal force. 1952) .

particularly in areas where the entry has not yet been made .KEY INFORMANTS (KI) INTERVIEW An important qualitative method.

ESSENTIAL FEATURES OF KI INTERVIEWS Selection of KI KI should. y trustworthy and y should have other personal attributes conducive to conducting detailed interviews. . y willing to participate. y articulate. y Has unique position in the community Conducting Interviews y The interview should be characterized by Silent Probe Phased assertion.

precise detail. Burgess termed the case study method.CASE STUDIES A fairly exhaustive study of a person or group is called a life or case history or case study. 1973) A case study explores the social process while statistical technique reveals the extent & degree of association . Because of its aid in studying behaviour in specific. It deepens our perception & give us clear insight into life. `the social microscopes' (Young.

The social situation must be studied to understand the degree of social pressures. The continuous related character of experience from childhood through adulthood should be stressed.THE MAJOR CRITERIA FOR LIFE HISTORY STUDY Behaviour of an individual must be viewed as a response to definite social stimulations. social participation exercised by the subject . The subject (he/she) must be viewed as a member of a cultural group/community.

an individual supplies structure to unstructured stimuli in a manner consistent with the individual·s own unique pattern of conscious and unconscious needs. and ways of perceiving and responding Projective methods were initially used by psychologists and psychiatrists for the diagnosis and treatment of emotionally disordered patients . impulses. fears. desires.PROJECTIVE TECHNIQUE In a projective test. conflicts.

Projection is greater to stimulus material that is similar to the examinee. Every response provides meaning for personality analysis. the more examinees reveal about their personality. There is an ´unconscious. .ASSUMPTIONS The more ambiguous the stimuli.µ Subjects are unaware of what they disclose.

EXAMPLE . In this method respondents are asked to sketch reproductive organs or to label body parts and explain the functions. reproductive health issues. researchers thus can identify gaps that could be addressed through interventions. This method is useful to study people·s perceptions about human physiology. It is a comfortable means of expression for those respondents who feel shy to speak about reproduction and sexuality. 2002). .BODY MAPPING It is a projective technique in which respondents draw maps of human body (see Ulinetal.

IMPORTANCE OF COMBINING DIFFERENT DATA COLLECTION TECHNIQUES Mix of Quantitative and Qualitative Research Techniques Reduction in chances of bias More comprehensive understaing of study topic .

BIAS IN INFORMATION COLLECTION Defective Instruments Observers Bias Effect of the interview on thr informant Information Bias y These affect the validity and Reliability of the study .

PRETESTING AND PILOT STUDIES Pre-test helps in evaluating the different questions. It can also be used to familiarise interviewers with the questionnaire or schedule. y . y the language. y questionnaire format and y Interview process.

The questionnaire is checked for clarity and understanding and the prospective respondents are informed about the same. After this is established, interviewer can ask the respondent what came to his mind when the question was put forward. Respondent's answer helps the researcher in understanding whether the question evokes what it was supposed to evoke or not. If it does not, then the wording of the question ought to change. In this way, confusing words and phrases can be avoided.


When a respondent hesitates to answer or is unable to understand a question, additional questions intended to overcome hesitancy or misunderstanding help in modifying the questionnaire. The researcher who developed the questionnaire should himself/herself conduct some of the pre-test interviews as it helps in evaluating the responses and determining whether changes should be made or not. Pre-testing should also be conducted in a population, which is very similar to the study population. Twenty-five to fifty pre-test interviews are usually sufficient to check the quality of the questionnaire. However, their number depends upon the purpose and availability of time and money. If pre-test is used for training the interviewers, then more interviews, can be conducted. The data obtained from the pre-test are not to be included in the final study.

PILOT SURVEY A series of small pre-tests can be conducted on the isolated problems of the design, and after establishing a broad plan of enquiry, it may take the form of a pilot survey, "a small replica of the main survey - a dress rehearsal". - Moser and Kalton

a bigger sample would be required. Finding variability within the population. even a smaller sample will be adequate. One can also evaluate the strain on and efficiency of interviewers. which is important to know for determining the sample design and size : If the variability is more.THE IMPORTANCE OF PRE-TESTS AND PILOT SURVEYS LIES IN Determining the adequacy of the for a study sampling frame : High hospital records are to be used. Estimating the non-response rates : Through pilot surveys one can estimate the refusal and non-contact rate and accordingly decide upon the appropriate technique of data collection. pre-test may be done to see their completeness. adequacy. . but if the variability is not much. up-todateness and convenience in obtaining such records.

If a large number of people refuse to answer a particular question. unambiguity of words. probably there is a need to remove it or change its language or place. there is a need to make the necessary changes. which has suggested some stereotyped answers. Similarly. and efficiency of the field organisation staff : Pre-tests and pilot surveys are effective instruments in checking whether the interviewers are able to follow the instructions properly or they misunderstand something. If the questions are unable to convey what they are intended to. a heavy concentration of responses at one extreme may be indicative of a leading question. clarity of definitions and use of technical terms. To determine the adequacy of instructions to the interviewers. The difficulties encountered during pilot surveys and pre-tests help in improving the questionnaire for the main study. . whether the codes allocated for different answers are adequate or not or is there a need to convert an open question to a structured question or vice-versa. codes chosen for pre-coded questions. Through pilot surveys one may also get some idea of the estimated cost of the main survey and consider the areas where economies can be made : Pilot surveys not only help in improving upon the questionnaire. a large number of `don't know' replies suggests a vague question. their placement. language. time and money. The size and design of pilot survey is a matter of convenience. but also give an insight in to the researcher whether there is really a need to carry out the main survey or not. For example.THE IMPORTANCE OF PRE-TESTS AND PILOT SURVEYS LIES IN To determine the usefulness of questionnaire : The adequacy of questions.

THE VALIDITY OF MEASUREMENT/ TOOL Basic questions must be asked about any measuring instrument What does it measure? y Are the data it provides relevant to the characteristic in which one is interested? y Do the differences in scores represent the differences on the characteristic one is trying to measure. or do they reflect also the influence of other factors? y .

WAYS TO EVALUATE THE VALIDITY OF THE INSTRUMENT Face Validity Concurrent Validity Predictive Validity Construct Validity .

the higher the face validity. but we could calculate the validity figures by computing the amount of agreement between judges. sometimes experts. Evaluating the face validity is a subjective process. Every researcher who chooses an instrument is a judge who has decided that the test measures the concept he or she wishes to study. Without such minimal face validity. Every instrument must pass the face validity test either formally or informally. . an instrument would not be used. The higher the percent who says it measures what it claims to measure.FACE VALIDITY Face validity is evaluated by a group of judges. who read or look at a measuring technique and decide whether in their opinion it measures what its name suggests.

it could not be considered to measure religiosity with validity. If the test failed to discriminate between the two groups. to be active in religious activities and otherwise to give evidence of high religiosity. the questions could be tested by administering them to one group known to be religious.CONCURRENT VALIDITY Concurrent validity is the ability of a measuring instrument to distinguish between individuals who are known to differ. . if a scale were being devised for the purpose of measuring religiosity. T hese answers would then be compared with those from a group known not to be very religious and also known to oppose religious behaviour in other ways. Thus.

.PREDICTIVE VALIDITY Predictive validity is the ability of a measuring instrument to identify future differences. the predictive validity of a scale measuring attitude towards birth control is the ability of the scale to identify who will eventually adopt contraception and who will not practise contraception. Predictive validity is an evaluation of a measure's practical worth in foreseeing the future. For instance.

CONSTRUCT VALIDITY Construct validity is an evaluation of the extent to which an instrument measures the theoretical construct the investigator wishes to measure. It requires a demonstration that the construct in question exists. and that the instrument measures that particular construct and no other. construct validity requires more than expert opinion. Unlike face validity. that it is distinct from other constructs. .

When independent and comparable measures of the same thing are obtained. The reliability of a measuring instrument should be determined before it is used in a study . but a variety of constant and random errors. which the instrument is attempting to measure. they will yield the same results to the extent that the measurements are free from random or variable errors.THE RELIABILITY OF MEASUREMENT /INSTRUMENT scores on measuring instruments usually reflect not only the characteristics. The evaluation of the reliability of any measurement procedure consists of determining how much of the variation in scores among individuals is due to inconsistencies in measurement.

You're Reading a Free Preview

/*********** DO NOT ALTER ANYTHING BELOW THIS LINE ! ************/ var s_code=s.t();if(s_code)document.write(s_code)//-->