Not All Surveys Are Equal

The other day I heard a conservative commentator, Sean Hannity, state that 85% of Americans are happy with their healthcare plan. His used the poll to argue that Obama and healthcare advocates are pandering only to those who lack insurance and a few on the fringe. I have mentioned the statement to four people so far and none of them would answer the question in the affirmative. So why the difference?

I have no doubts regarding the results of the survey question was 85%. By carefully crafting the question it is not hard to design surveys to yield the results you desire. This is even more true when the question is preceded by other carefully crafted questions that help set up the key question or questions. Due to this dynamic, most academic researchers associated with colleges and universities are required by their institutions to submit their questions for peer review to ensure that they are truly neutral and being asked in a framework that gives reliable results.

A large number of surveys conducted by political operatives are far from neutral, they are strong push surveys. The main question is at the end of a series of carefully crafted questions that draw the responder to answer yes and give the desired results. The results are then trumpeted and used to further a political agenda. If the survey was conducted in a balanced and neutral fashion the results would be significantly different. These politically driven surveys are disingenuous at best.

Not all surveys truly reflect public opinions. A good dose of askance is appropriate in looking at results. Look behind the survey, not only the question but the context of the question and the questions that precede it as not all surveys are equal or dependable.