Do surveys have any value?
I just had a woman from a survey company in my house asking me questions about local government.
It seemed to me there was so much wrong with what she was doing, that I wonder if I can ever take the findings of such surveys seriously again.
Here are just some of the things that would skew the results:
1. she hurried me for my answers, forcing me to tick boxes before I had had a chance to read all the options or seriously consider what I really felt
2. she asked many questions where there were really two possible answers: what I really felt and what I wanted the local council sponsoring the survey to hear. Sometimes I went with the former, sometimes with the latter.
3. in a few cases she forced me to choose from options that did not include anything that accurately reflected my view
4. she forced me to choose five topics from a list of 20, when I felt like choosing 8 and couldn't distinguish between their relative importance
5. in some cases I found myself giving answers that sounded like the right thing to say rather than answers that reflected my true feelings
6. in some cases I didn't really understand what was being asked of me.
If you multiply this blurring of the data many times over and then add in human error and statistical error and respondents who choose to be perverse, and respondents who are just having a bad day, surely what you get at the end of it all is a pile of meaningless garbage?