The perception of reproducibility in a small cohort of scientists in Europe
Author(s) / Creator(s)
Didio, Giuliano
Casarotto, Plinio
Abstract / Description
Reproducibility is an essential feature of all scientific outcomes. Scientific evidence can only reach its true status as reliable if replicated, but the results of well-conducted replication studies face an uphill battle to be performed, and little attention and dedication have been put into publishing the results of replication attempts. Therefore, we asked a small cohort of researchers about their attempts to replicate results from other groups, as well as from their own laboratories, and their general perception of the issues concerning reproducibility in their field. We also asked how they perceive the venues, i.e. journals, to communicate and discuss the results of these attempts. To this aim we pre-registered and shared a questionnaire among scientists at diverse levels. The results indicate that, in general, replication attempts of their own protocols are quite successful (with over 80% reporting not or rarely having problems with their own protocols). Although the majority of respondents tried to replicate a study or experiment from other labs (75.4%), the median successful rate was scored at 3 (in a 1-5 scale), while the median for the general estimation of replication success in their field was found to be 5 (in a 1-10 scale). The majority of respondents (70.2%) also perceive journals as unwelcoming of replication studies.
Keyword(s)
Reproducibility Replicability Perception Journal policyPersistent Identifier
Date of first publication
2021-06-24
Journal title
Neuroanatomy and Behaviour
Volume
3
Article number
e20
Publisher
Episteme Health Inc.
Publication status
publishedVersion
Review status
peerReviewed
Is version of
Citation
Didio, G., & Casarotto, P. (2021). The perception of reproducibility in a small cohort of scientists in Europe. Neuroanatomy and Behaviour, 3, e20. http://dx.doi.org/10.23668/psycharchives.4934
-
nab.2021.e20.pdfAdobe PDF - 797.94KBMD5: 774f8fc7d5926f17a1b317c285fbcd22Description: Version of Record
-
There are no other versions of this object.
-
Author(s) / Creator(s)Didio, Giuliano
-
Author(s) / Creator(s)Casarotto, Plinio
-
PsychArchives acquisition timestamp2021-06-24T18:34:54Z
-
Made available on2021-06-24T18:34:54Z
-
Date of first publication2021-06-24
-
Abstract / DescriptionReproducibility is an essential feature of all scientific outcomes. Scientific evidence can only reach its true status as reliable if replicated, but the results of well-conducted replication studies face an uphill battle to be performed, and little attention and dedication have been put into publishing the results of replication attempts. Therefore, we asked a small cohort of researchers about their attempts to replicate results from other groups, as well as from their own laboratories, and their general perception of the issues concerning reproducibility in their field. We also asked how they perceive the venues, i.e. journals, to communicate and discuss the results of these attempts. To this aim we pre-registered and shared a questionnaire among scientists at diverse levels. The results indicate that, in general, replication attempts of their own protocols are quite successful (with over 80% reporting not or rarely having problems with their own protocols). Although the majority of respondents tried to replicate a study or experiment from other labs (75.4%), the median successful rate was scored at 3 (in a 1-5 scale), while the median for the general estimation of replication success in their field was found to be 5 (in a 1-10 scale). The majority of respondents (70.2%) also perceive journals as unwelcoming of replication studies.en
-
Publication statuspublishedVersionen
-
Review statuspeerRevieweden
-
CitationDidio, G., & Casarotto, P. (2021). The perception of reproducibility in a small cohort of scientists in Europe. Neuroanatomy and Behaviour, 3, e20. http://dx.doi.org/10.23668/psycharchives.4934en
-
ISSN2652-1768
-
Persistent Identifierhttps://hdl.handle.net/20.500.12034/4362
-
Persistent Identifierhttps://doi.org/10.23668/psycharchives.4934
-
Language of contenteng
-
PublisherEpisteme Health Inc.en
-
Is version ofhttps://doi.org/10.35430/nab.2021.e20
-
Keyword(s)Reproducibilityen
-
Keyword(s)Replicabilityen
-
Keyword(s)Perceptionen
-
Keyword(s)Journal policyen
-
Dewey Decimal Classification number(s)150
-
TitleThe perception of reproducibility in a small cohort of scientists in Europeen
-
DRO typearticleen
-
Article numbere20
-
Journal titleNeuroanatomy and Behaviouren
-
Volume3
-
Visible tag(s)Version of Record