Question Wording and Stated Opinions

Jeffrey Toobin (The New Yorker, 8/5/13), in discussing “The fight for abortion rights”, says that “[w]hen it comes to public opinion about abortion, a great deal depends on how questions are asked”.  Toobin is right to point out that “how questions are asked”–question wording–affects/skews answers.  And this is the case whether questions are about abortion or any other topic.  It’s impossible to word a question that does not affect the answer to that question.

However, Toobin is off the mark when he fails to acknowledge that what he calls “public opinion about abortion” is nothing more than what people/respondents say is their opinion; it’s their stated opinions; their answers to questions.  As we all know, what people say is their opinion is not necessary their actual opinion.  Stated opinions are affected/skewed, not only by question wording (see above) and other components of asking instruments, but also by respondents, characteristics of situations in which questions are asked and answers given, and attributes and behaviors of askers.

So when you want to find out about opinions or anything else, don’t ask.  That’s the theme of my book, The Problem with Survey Research; my effort to erode confidence in survey research and, thereby, make other procedures–such as experimentation and logical/predictive model building and testing–more attractive and more widely used.

 

About georgebeam

George Beam is an educator and author. The perspectives that inform his interpretations of the topics of this blog–-as well as his other writings and university courses -–are system analysis, behaviorism, and Internet effects. Specific interests include quality management, methodology, and politics. He is Associate Professor Emeritus, Department of Public Administration; Affiliated Faculty, Department of Political Science; and, previously, Head, Department of Public Administration, University of Illinois at Chicago
This entry was posted in Survey Research and tagged , , , , , . Bookmark the permalink.

2 Responses to Question Wording and Stated Opinions

  1. Pingback: Question Wording Makes Answers Unreliable | George Beam's Blog

  2. Pingback: Question Wording, Change in Wording, and Rosa’s Law | George Beam's Blog

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s