A Spanish Continuous Volunteer Web Surveysample Bias, Weighting and Efficiency

  1. Pedraza García, Pablo de
  2. Tijdens, Kea
  3. Muñoz de Bustillo Llorente, Rafael
  4. Steinmetz, Stephanie
Revista:
REIS: Revista Española de Investigaciones Sociológicas

ISSN: 0210-5233

Año de publicación: 2010

Número: 131

Páginas: 109-130

Tipo: Artículo

DIALNET GOOGLE SCHOLAR lock_openDialnet editor

Otras publicaciones en: REIS: Revista Española de Investigaciones Sociológicas

Resumen

Utilizando los datos obtenidos mediante una encuesta continua en Internet (CVWS), tusalario.es (WI), que tiene como población objetivo la población activa española, el trabajo analiza, en primer lugar, el sesgo que dicho método de encuesta produce. En segundo lugar, aplica dos metodologías de ponderación con la intención de corregir los errores de representatividad. En tercer lugar, para saber si la ponderación de los datos corrige el sesgo y hace posible la obtención de resultados y conclusiones aplicables al conjunto de la población activa, la eficiencia de ambas metodologías de ponderación es evaluada. La estrategia de evaluación consiste en comparar salarios medios, índices de desigualdad y regresiones salariales obtenidos antes y después de ponderar los datos del WI con aquellos que pueden obtenerse utilizando los datos de la Encuesta de Estructura Salarial (SES), que lleva a cabo el Instituto Nacional de Estadística. Los estadísticos y parámetros estimados se mueven en la dirección correcta después de ponderar.

Referencias bibliográficas

  • Angrist, Joshua D. and Jörn-Steffen Pischke (2009Mostly Harmless Econometrics: An Empiricist's Companion, Princeton: Princeton University Press.
  • Bandilla, Wolfgang, Michael Bosnjak and Patrick Altdorf (2003"Survey administration effects? A comparison of web-based and traditional written self-administered surveys using the ISSP environment module ",Social Science Computer Review, 21 (2235-243.
  • Bandilla, Wolfgang et al. (2009"Coverage und Nonresponse-Effekte bei Online-Bevölkerungsumfragen, ",in Sozialforschung im Internet: Methodologie und Praxis der Online-Befragung, eds. N. Jackob, H. Schoen and T. Zerback, VS Verlag für Sozialwissenschaften.
  • Bethlehem, J. and I. Stoop (2006"Online Panels A Paradigm Theft? ", in Annual Meeting of the Association for Survey Computing.
  • Birnbaum, Michael H. (2004):"Human Research and Data Collection Via the Internet ", Annual Review of Psychology, 55: 803-832.
  • Bosnjak, Michael and Tracy L. Tuten (2003):"Prepaid and promised incentives in web surveys ", Social Science Computer Review, 21 (2208-217.
  • Bronner, Fraser and Ton Kuijlen (2007):"The live or digital Interviewer: A comparison between CASI, CAPI and CATI with respect to differences in response behaviour ", International Journal of Market Research, 49 (2167-190.
  • Chen Wenhong, Jeffrey Boase and Barry Wellman (2002):"The Global Villagers: Comparing Internet Users and Uses around the World", in The Internet in Everyday Life, ed. Wellman, Haythornthwaite, Oxford: Blackwell.
  • Coderre, François, Anne Mathieu and Natalie St-Laurent (2004):"Comparison of the quality of qualitative data obtained through telephone, postal and email surveys", International Journal of Market Research, 46 (347-357).
  • Couper, Mick P., Johnny Blair and Timothy Triplett (1999):"A Comparison of Mail and E-Mail for a Survey of Employees in Federal Statistical Agencies" Journal of Official Statistics, 15 (139-156).
  • Couper, Mick P. (2000):"Web surveys: a review of issues and approaches, Public Opinion Quarterly, 64 (464-481).
  • Couper, Mick P. and Peter Miller (2008):"Web survey methods Introduction", Public Opinion Quarterly, 72 (831-835).
  • Couper, Mick P. et al. (2008):"Risk of disclosure, perceptions of risk, and concerns about privacy and confidentiality as factors in survey participation", Journal of Official Statistics, 24 (255-275).
  • Couper, Mick P. et al. (2007):"Noncoverage and nonresponse in an Internet survey", Social Science Research, 36 (131-148).
  • Couper, Mick P., Eleanor Singer and Roger Tourangeau (2004):"Does voice matter? An interactive voice response (IVR) experiment", Journal of Official Statistics, 20 (551-570).
  • de Leeuw, Edith D., Joop J. Hox and Don A. Dillman (2008International Handbook of Survey Methodology, New York, NY: Lawrence Erlbaum Associates.
  • Deaton, Angus (1997The Analysis of Household Surveys: A Microeconometric Approach to Development Policy. ISBN 0-8018-5254-4.
  • Dever, Jill A., Ann Rafferty and Richard Valliant (2008):"Internet surveys: can statistical adjustments eliminate coverage bias? ", Survey Research Methods, 2 (247-62).
  • Dillman, Don A. and Denise Bowker (2001The Web Questionnaire Challenge to Survey Methodologists, in Dimensions of Internet Science, eds. Ulf-Dietrich Reips and Michael Bosnjak, Lengerich: Pabst Science Publishers.
  • Dillman, Don A., Jolene Smyth and Christian Leah (2009):Internet, Mail and Mixed-Mode Surveys: the tailored design method, ed. John Wiley, Holboken, 3th Edition.
  • Duffy, Bobby et al. (2005):"Comparing Data from online and Face-to-Face surveys", International Journal of Market Research, 47 (615-639).
  • Escobar, Modesto, Enrique Fernández and Fabrizio Bernardi (2009). Análisis de datos con Stata, Madrid: Centro de Investigaciones Sociológicas.
  • Fricker, Scott et al. (2005):"An Experimental Comparison of Web and Telephone Surveys", Public Opinion Quarterly, 69 (370-392).
  • Fricker, Ronald D. (2008):"Sampling methods for web and E-mail surveys", in The SAGE Handbook of Online Research Methods, eds. N. Fielding, R. M. Lee and G. Blank, London: Sage.
  • Fricker, Ronald and Mathias Schonlau (2002):"Advantages and disadvantages of Internet research surveys: Evidence from the literature", Field Methods, 14: 347-367.
  • Galesic, Mirta (2006):"Dropouts on the web: effects of interest and burden experienced during an online survey", Journal of Official Statistics, 22 (313-328).
  • Göritz, Anja S. (2006):"Cash lotteries as incentives in online panels", Social Science Computer Review, 24 (445-459).
  • Healey, Benjamin (2007):"Drop downs and scroll mice: the effect of response option format and input mechanism employed on data quality in web surveys", Social Science Computer Review, 25 (111-128.
  • Heerwegh, Dirk (2005):"Effects of personal salutations in E-mail invitations to participate in a web survey", Public Opinion Quarterly, 69 (588-598).
  • Ilieva, Janet, Steven Baron and Nigel M. Healey (2002):"Online surveys in marketing research: pros and cons", International Journal of Marketing Research, 44 (361-376).
  • Kaczmirek, Lars (2008):"Human-Survey Interaction: Usability and Nonresponse in Online Surveys", ed. Mannheim: MADOC.
  • Kaplowitz, Michael, Timothy Hadlock and Ralph Levine (2004):"A comparison of web and mail survey response rates", Public Opinion Quarterly, 68 (194-101).
  • Kiesler, Sara and Lee Sproull (2001Human Values and the Design of Computer Technology, ed. Centre for the Study of Language and Information.
  • Lee, Sunghee and Richard Vaillant (2009):"Estimation for volunteer panel web surveys using propensity score adjustment and calibration adjustment", Sociological Methods Research, 37 (319-343).
  • Llauradó, Oriol (2006):"El trabajo de campo online: qué hemos aprendido en los últimos 10 años", Investigación y Marketing (Monográfico sobre la investigación online; el impacto de la nuevas tecnologías), 91 (junio 25-40.
  • López, Antoni (2006):"Que las escasas diferencias no nos impidan aprovechar las ventajas de Access Panel Online", Investigación y Marketing, 91 (junio 20-24).
  • López, Antoni (2008):"¿Seguimos hablando del on-line? ", Investigación y Marketing, 98 (marzo 28-30).
  • Loosveldt, Geer and Nathalie Snock (2008):"An evaluation of the weighting procedures for online access panel surveys", Survey Research Methods, 2 (293-105).
  • Lozar Manfreda, Katja et al. (2008):"Web surveys versus other survey modes: A meta-analysis comparing response rates", International Journal of Market Research, 50 (179-104).
  • Lynn, Peter (2008):"The problem of nonresponse", in International Handbook of Survey Methodology, eds. E. D. De Leeuw, J. Hox and D. A. Dillman, New York: Lawrence Erlbaum Associates.
  • Malhotra, Neil and Jon A. Krosnick (2007):"The effect of survey mode and sampling on inferences about political attitudes and behaviour: comparing the 2000 and 2004 ANES to Internet surveys with nonprobability samples", Political Analysis, 15 (286-324).
  • Muñoz de Bustillo, Rafael and Pablo de Pedraza (2010):"Determinants of Job Insecurity in 5 European Countries", European Journal of Industrial Relations, 16 (15-20).
  • Porter, Stephen R. and Michael E. Whitcomb (2003):"The Impact of Contact Type on Web Survey Response Rates", Public Opinion Quarterly, 67 (579-588).
  • Pratesi, Monica et al. (2004):"List-based web surveys: Quality, timeliness, and nonresponse in the steps of the participation flow", Journal of Official Statistics, 20 (451-465).
  • Rosenbaum, Paul R. and Donald B. Rubin (1983):"The central role of the propensity score in observational studies for causal effects", Biometrika, 70: 41-55.
  • Roster, Catherine et al. (2004A comparison of response characteristics from web and telephone surveys", International Journal of Market Research, 446 (359-373).
  • Schaefer, David R. and Don A. Dillman (1998):"Development of a Standard E-Mail Methodology: Results from an Experiment", Public Opinion Quarterly, 62 (378-397).
  • Scherpenzeel, A. and M. Das (2009):"True' Internet panels: evidence from the Netherlands", in Social Research and the Internet: Advances in Applied Methods, eds. M. Das, P. Ester and L. Kaczmirek, Boca Raton: Taylor & Francis.
  • Schneider, Sid J. et al. (2005):"Telephone, internet, and paper data collection modes for census 2000 short form", Journal of Official Statistics, 21 (189-101).
  • Schonlau, Mathias et al. (2009):"Selection bias in web surveys and the use of propensity scores", Sociological Methods Research, 37 (291-318).
  • Shih, Tse-Hua and Xitao Fan (2008):"Comparing response rates from web and mail surveys: A meta-analysis", Field Methods, 20 (249-271).
  • Steinmetz, Stephanie, Kea Tijdens and Pablo de Pedraza (2009):"Comparing different weighting procedures for volunteer on line panels lessons to be learned from German, Dutch and Spanish Wage Indicator data".Presented at ESRA Conference 2009 Warsaw.
  • Sparrow, Nick (2006):"Developing Reliable On Line Polls", International Journal of Market Research, 48.
  • Taylor, Humpfrey (2005):"Does Internet research "work"? Comparing online survey results with telephone surveys", International Journal of Market Research, 42 (151-63).
  • Tingling, Peter, Michael Parent and Michael Wade (2003):"Extending the capabilities of internet-based research: lessons from the field", Internet Research, 13 (223-235).
  • Tourangeau, Roger, Mick Couper and Frederick Conrad (2006):"Color, labels, and interpretive heuristics for response scales", Public Opinion Quarterly, 71 (191-112).
  • Tuten, Tracy L., David J. Urban and Michael Bosnjak (2002):"Internet Surveys and Data Quality A Review", in Online Social Science, eds. B. Batinic, U. D. Reips and M. Bosnjak, Seattle, WA: Hogrefe and Huber Publishers.
  • Vehovar, Vasja and Katia Manfreda (1999):"Web surveys: Can the weighting solve the problem? ", Research Methods, pp. 962-967.
  • Visser, Jelle (2006):"Union membership statistics in 24 countries", Monthly Labour Review (January 38-49).
Fuente de los datos: Dialnet