Potential Pitfalls in Questionnaires

There are a number of potential problems you need to be careful to avoid when setting short
answer questions. Make sure the questions are answerable and that they will tell you what you
wish to know.

Issue Example Potential Pitfalls

Assumptions Which textbook do you consult? The respondent may not consult any
textbook, or may consult many.

Double barrelled Do you always attend the lectures and May attend none, only one or both.
the tutorials?

Double negative Do you not agree that lecture notes State in the positive otherwise can be
should not be the only source material confusing.
consulted?

Leading Do you agree that working with tutorial Leads the respondent towards a
partners helps your learning? particular perspective. Turn into an
open ended question.

Imprecise wording How much time, on average, do you ‘A great deal’ and ‘A certain amount’
spend writing your essay? (A great may mean different things to different
deal; A certain amount; None) people.

Memory What were the names and titles of the May not remember. May give you
main texts you used? names to please you.

Offensive How many times have you been Represents an invasion of privacy. Do
reprimanded before for a similar you need to know?
reason?

Oxford Learning Institute www.learning.ox.ac.uk