Acta Oeconomica Pragensia 2016, 24(6):3-15 | DOI: 10.18267/j.aop.560
Pitfalls of Quantitative Surveys Online
- University of Economics, Prague; Faculty of Informatics and Statistics (iva.pecakova@vse.cz).
With the development of the Internet in the last two decades, its use in all phases of field survey is growing very quickly. Indeed, it reduces costs while allowing exploration of relatively large files and enables effective use of a variety of research tools. The academic research is more reserved towards developing online surveys. Demands on the quality of data are the main cause; Internet surveys do not meet them and thus do not allow drawing objective conclusion about the populations surveyed.
Unqualified use of the Internet may significantly influence data and information obtained from their analysis. The problematic definition of the population that is under investigation may result in a fault of its coverage. Its existence can be shown, for example, on a confrontation of the total and Internet population of the Czech Republic, the total and Internet population of the Czech households, etc. Representation of the population through an online panel may cause bias, depending on how the panel is created. A relatively new source of error in an online survey is the existence of "professional" respondents.
The sampling method from a population or an online panel can lead to the emergence of such a sample that is not representative and does not allow inference to the population at all, or only in a very limited way. Even probability sampling, however, can be problematic if it is affected by a higher rate of non-responses. The aim of this paper is to summarise the possible sources of bias associated with any sample survey, but also to draw attention to those that are relatively new and are associated with the implementation of just quantitative surveys online.
Keywords: quantitative survey, survey online, sample survey
JEL classification: C10, C18, C83
Published: October 1, 2016 Show citation
References
- BAKER, R., BLUMBERG, S. & BRICK, J., 2010. AAPOR Report on Online Panels. The Public Opinion Quarterly, 74(4), 711-781. ISSN 1537-5331.
Go to original source...
- BRICK, J., 2011. The future of Survey Sampling. The Public Opinion Quarterly, 75(5), 872-889. ISSN 1537-5331.
Go to original source...
- COUPER, M. P., BLAIR, J. & TRIPLETT, T., 1999. A comparison of mail and e-mail for a survey of employees in federal statistical agencies. Journal of Official Statistics, 15, 39-56. ISSN 2001-7367.
- CZSO, 2016. Information Society in Figures [online]. [accessed August 25, 2016]. Available at: https://www.czso.cz/csu/czso/information-society-in-figures-2016
- CZSO (ČESKÝ STATISTICKÝ ÚŘAD), 2016a. Informační společnost v číslech - 2016 [online]. [accessed August 25, 2016]. Available at: www.czso.cz/csu/czso/informacni-spolecnost-v-cislech-2016
- CZSO, 2016b. Informační technologie v domácnostech a mezi jednotlivci [online]. [accessed August 27, 2016]. Available at: www.czso.cz/csu/czso/domacnosti_a_jednotlivci
- CZSO, 2016c. Obyvatelstvo [online]. [accessed August 27, 2016]. Available at: www.czso.cz/csu/czso/obyvatelstvo_lide
- CZSO, 2016d. Veřejná databáze [online]. [accessed August 25, 2016]. Available at: vdb.czso.cz
- DILLMAN, D. A., TORTORA, R. D. & BOWKER, D., 1999. Principles for Constructing Web Surveys [online]. [accessed August 25, 2016]. Available at: https://www.researchgate.net/profile/Don_Dillman/publication/2465935_Principles_for_Constructing_Web_Surveys/links/549813cb0cf2519f5a1db6de.pdf
- FRICKER, S., GALESIC, M., TOURANGEAU, R. & YAN, T., 2005. An Experimental Comparison of Web and Telephone Survey. Public Opinion Quarterly, 69 (3), 370-392. ISSN 1537-5331.
Go to original source...
- GITTELMAN, S. & TRIMARCHI, E., 2009. Variance between purchasing behavior profiles in a wide spectrum of online sample sources [online]. [accessed June 20, 2016]. White Paper, Marketing. Inc. Available at: http://www.mktginc.com/pdf/Short_%20Variance.pdf
- GROVES, M. R., 2006. Nonresponse Rates and Nonresponse Bias in Household Surveys. Public Opinion Quarterly, 70(5), 646-675. ISSN 2001-7367.
Go to original source...
- GROVES, M. R., 2011. Three Eras of Survey Research, Public Opinion Quarterly, 75(5), 861-871. ISSN 2001-7367.
Go to original source...
- KRUSKAL, W. & MOSTELLER, F., 1979. Representative Sampling, III. The Current Statistical Literature. International Statistical Revue, 47(3), 245-265. ISSN 1751-5823.
Go to original source...
- LEEUW, E. & MATTHIJSSE, S., 2016. Professional Respondents in Online Panels: Threat or Blessing? [online]. [accessed August 25, 2016]. Available at: http://www.marketingresearch.org/article/professional-respondents-online-panels
- MINIWATTS MARKETING GROUP, 2016. Internet World Stats [online]. Internet World Stats, Usage and Population Statistics [accessed August 25, 2016]. Available at: http://www.internetworldstats.com
- PECÁKOVÁ, I., 2011. Statistika v terénních průzkumech. Praha: Professional Publishing. ISBN 978-80-7431-039-3.
- STATISTA, 2016. Online Research as a Share of Market Research Spend Worldwide from 2009 to 2015 [online]. [accessed August 25, 2016]. Available at: www.statista.com/statistics/491140/share-online-market-research-spend
- VONK, T., van OSSENBRUGGEN, R. & WILLEMS, P., 2006. The Effects of Panel Recruitment and Management on Research Results; A Study Across 19 Panels. ESOMAR Publication Services, 317, 79-99.
This is an open access article distributed under the terms of the Creative Commons Attribution 4.0 International License (CC BY 4.0), which permits use, distribution, and reproduction in any medium, provided the original publication is properly cited. No use, distribution or reproduction is permitted which does not comply with these terms.