News release of The Problem with Survey Research

My university, University of Illinois at Chicago, via Newswise – http://www.newswise.com/articles/new-book-examines-the-problem-with-survey-research – issued the following news release concerning my new book, The Problem with Survey Research:

Newswise — Social scientists and marketers expressed dismay when the U.S. House of Representatives recently voted to eliminate the Census Bureau’s American Community Survey, a source of data on income, housing, education, labor force and other demographics.

However, a University of Illinois at Chicago researcher maintains that this and other surveys, polls, interviews, and focus groups produce unreliable results.

In “The Problem with Survey Research” (Transaction Publishers, 2012), George Beam, UIC associate professor of public administration, argues that survey research produces only responses to questions.

“If you want to find out what’s really going on, don’t ask,” Beam advises researchers. Reliable information, he says, can be acquired only by observation, experimentation, formal modeling, document analysis, comparison, and using multiple sources of data.

“When all you have are answers, it’s impossible to know which, if any, are correct,” Beam said. “Low response rates, wording, setting, the matter of who’s asking — all affect the responses. Researchers can’t know whether the answers correspond to respondents’ actual behaviors or their true beliefs.

Beam notes that researchers recognize the drawbacks of survey research, but continue conducting it because it is institutionalized.

In the case of the American Community Survey, Beam said, “unreliable answers determine how more than $400 billion in national and state funds are distributed. Answers are skewed by the sensitivity of questions like, ‘What time do you leave for work? Do you need help in going shopping? Your income?’  And by the threat of a $5,000 fine for not responding.

“The problem extends beyond the academic and government realms,” he said. “The media also rely on polls and interviews.”

In his book, Beam explains the ubiquity of survey research, its documented unreliability, the ambiguous design of oral and written survey instruments, and how settings and sources affect responses.

Beam suggests more scientific methods of research in his final chapters. In an appendix, he discusses surveys that are not meant to produce usable information, but simply allow respondents to speak their minds, receive an advertising message, or support a candidate or business.

About georgebeam

George Beam is an educator and author. The perspectives that inform his interpretations of the topics of this blog–-as well as his other writings and university courses -–are system analysis, behaviorism, and Internet effects. Specific interests include quality management, methodology, and politics. He is Associate Professor Emeritus, Department of Public Administration; Affiliated Faculty, Department of Political Science; and, previously, Head, Department of Public Administration, University of Illinois at Chicago
This entry was posted in Survey Research and tagged , , , . Bookmark the permalink.

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s