Moderators of Panel Conditioning in Sensitive Questions. A Meta-Analysis
Author(s) / Creator(s)
Burgard, Tanja
Kasten, Nadine
Bosnjak, Michael
Abstract / Description
Relevance & Research Question: Panel Conditioning is a learning effect, that can endanger the validity of results from panel studies. It describes actual changes in attitudes or behaviors or the way they are reported due to participation in former survey waves. Panel conditioning effects are heterogeneous and can manifest in different ways. For example, experience in survey participation may lead to more frequent negative answering of filter questions to reduce response burden. Other possible effects are changes in knowledge or reduction of social desirable answering. As these effects are too diverse to determine one overall effect, moderator and subgroup analyses are necessary for investigation. Corresponding moderating influences such as the design and timing of the surveys or the year of data collection are examined, too. Methods & Data: To be included in the meta-analysis, articles had to report (quasi-)experiments, involving a control group of fresh respondents or actuary information from a registry and at least one group of conditioned respondents. Both groups had to be exposed to identical survey questions to enable between-group comparisons of quantitative outcomes. 44 reports met these criteria. Within the 25 reports coded up to now, 115 single studies were defined. These studies contain 346 effect sizes in total. The effect sizes are nested within the studies and to account for this dependency, three-level mixed-effects models will be used. Results: First analyses showed, that panel conditioning effects are more pronounced for knowledge questions than for other types of questions. Further moderating effects were weak and mostly not significant in the current data set, which will be extended soon. Added Value: The differentiation of different types of conditioning enables conclusions concerning the effects of PC on data quality. Moreover, recommendations on the timing and design of panel surveys, as well as an appropriate operationalization of repeated items are the aim of the meta-analysis.
Persistent Identifier
Date of first publication
2019-07-18
Is part of
Conference of the European Survey Research Association (ESRA) 2019, Zagreb, Croatia
Publisher
PsychArchives
Citation
Burgard, T., Kasten, N., & Bosnjak, M. (2019, July 18). Moderators of Panel Conditioning in Sensitive Questions. A Meta-Analysis. PsychArchives. https://doi.org/10.23668/psycharchives.2517
-
Burgard_Panel Conditioning.pdfAdobe PDF - 379.68KBMD5: 3a935d4278758d7a692a013df57f338cDescription: Conference Object
-
There are no other versions of this object.
-
Author(s) / Creator(s)Burgard, Tanja
-
Author(s) / Creator(s)Kasten, Nadine
-
Author(s) / Creator(s)Bosnjak, Michael
-
PsychArchives acquisition timestamp2019-07-17T13:28:53Z
-
Made available on2019-07-17T13:28:53Z
-
Date of first publication2019-07-18
-
Abstract / DescriptionRelevance & Research Question: Panel Conditioning is a learning effect, that can endanger the validity of results from panel studies. It describes actual changes in attitudes or behaviors or the way they are reported due to participation in former survey waves. Panel conditioning effects are heterogeneous and can manifest in different ways. For example, experience in survey participation may lead to more frequent negative answering of filter questions to reduce response burden. Other possible effects are changes in knowledge or reduction of social desirable answering. As these effects are too diverse to determine one overall effect, moderator and subgroup analyses are necessary for investigation. Corresponding moderating influences such as the design and timing of the surveys or the year of data collection are examined, too. Methods & Data: To be included in the meta-analysis, articles had to report (quasi-)experiments, involving a control group of fresh respondents or actuary information from a registry and at least one group of conditioned respondents. Both groups had to be exposed to identical survey questions to enable between-group comparisons of quantitative outcomes. 44 reports met these criteria. Within the 25 reports coded up to now, 115 single studies were defined. These studies contain 346 effect sizes in total. The effect sizes are nested within the studies and to account for this dependency, three-level mixed-effects models will be used. Results: First analyses showed, that panel conditioning effects are more pronounced for knowledge questions than for other types of questions. Further moderating effects were weak and mostly not significant in the current data set, which will be extended soon. Added Value: The differentiation of different types of conditioning enables conclusions concerning the effects of PC on data quality. Moreover, recommendations on the timing and design of panel surveys, as well as an appropriate operationalization of repeated items are the aim of the meta-analysis.en_US
-
CitationBurgard, T., Kasten, N., & Bosnjak, M. (2019, July 18). Moderators of Panel Conditioning in Sensitive Questions. A Meta-Analysis. PsychArchives. https://doi.org/10.23668/psycharchives.2517en
-
Persistent Identifierhttps://hdl.handle.net/20.500.12034/2141
-
Persistent Identifierhttps://doi.org/10.23668/psycharchives.2517
-
Language of contentengen_US
-
PublisherPsychArchivesen_US
-
Is part ofConference of the European Survey Research Association (ESRA) 2019, Zagreb, Croatiaen_US
-
Dewey Decimal Classification number(s)150
-
TitleModerators of Panel Conditioning in Sensitive Questions. A Meta-Analysisen_US
-
DRO typeconferenceObjecten_US
-
Leibniz institute name(s) / abbreviation(s)ZPID