Ten steps toward a better personality science – how quality may be rewarded more in research evaluation
Author(s) / Creator(s)
Leising, Daniel
Thielmann, Isabel
Glöckner, Andreas
Gärtner, Anne
Schönbrodt, Felix
Abstract / Description
We point out ten steps that we think will go a long way in improving personality science. The first five steps focus on fostering consensus regarding (1) research goals, (2) terminology, (3) measurement practices, (4) data handling, and (5) the current state of theory and evidence. The other five steps focus on improving the credibility of empirical research, through (6) formal modelling, (7) mandatory pre-registration for confirmatory claims, (8) replication as a routine practice, (9) planning for informative studies (e.g., in terms of statistical power), and (10) making data, analysis scripts, and materials openly available. The current, quantity-based incentive structures in academia clearly stand in the way of implementing many of these practices, resulting in a research literature with sometimes questionable utility and/or integrity. As a solution, we propose a quality-based reward scheme that explicitly weights published research by its Good Science merits. Scientists need to be increasingly rewarded for doing good work, not just lots of work.
Keyword(s)
reproducibility credibility research evaluation assessment quality metrics publicationPersistent Identifier
Date of first publication
2021-07-08
Journal title
Personality Science
Publisher
PsychArchives
Publication status
acceptedVersion
Review status
reviewed
Is version of
Citation
Leising, D., Thielmann, I., Glöckner, A., Gärtner, A., & Schönbrodt, F. (in press). Ten steps toward a better personality science – How quality may be rewarded more in research evaluation [Author accepted manuscript]. Personality Science. http://doi.org/10.23668/psycharchives.4963
-
Leising_Thielmann_Glöckner_et_al._2021_Ten Steps Toward_PS_AAM.pdfAdobe PDF - 555.8KBMD5: 97ba3872399f65f3a88f2694cbe0edc6Description: Author Accepted Manuscript
-
There are no other versions of this object.
-
Author(s) / Creator(s)Leising, Daniel
-
Author(s) / Creator(s)Thielmann, Isabel
-
Author(s) / Creator(s)Glöckner, Andreas
-
Author(s) / Creator(s)Gärtner, Anne
-
Author(s) / Creator(s)Schönbrodt, Felix
-
PsychArchives acquisition timestamp2021-07-08T17:30:33Z
-
Made available on2021-07-08T17:30:33Z
-
Date of first publication2021-07-08
-
Abstract / DescriptionWe point out ten steps that we think will go a long way in improving personality science. The first five steps focus on fostering consensus regarding (1) research goals, (2) terminology, (3) measurement practices, (4) data handling, and (5) the current state of theory and evidence. The other five steps focus on improving the credibility of empirical research, through (6) formal modelling, (7) mandatory pre-registration for confirmatory claims, (8) replication as a routine practice, (9) planning for informative studies (e.g., in terms of statistical power), and (10) making data, analysis scripts, and materials openly available. The current, quantity-based incentive structures in academia clearly stand in the way of implementing many of these practices, resulting in a research literature with sometimes questionable utility and/or integrity. As a solution, we propose a quality-based reward scheme that explicitly weights published research by its Good Science merits. Scientists need to be increasingly rewarded for doing good work, not just lots of work.en_US
-
Publication statusacceptedVersion
-
Review statusreviewed
-
CitationLeising, D., Thielmann, I., Glöckner, A., Gärtner, A., & Schönbrodt, F. (in press). Ten steps toward a better personality science – How quality may be rewarded more in research evaluation [Author accepted manuscript]. Personality Science. http://doi.org/10.23668/psycharchives.4963en_US
-
ISSN2700-0710
-
Persistent Identifierhttps://hdl.handle.net/20.500.12034/4391
-
Persistent Identifierhttps://doi.org/10.23668/psycharchives.4963
-
Language of contentengen_US
-
PublisherPsychArchivesen_US
-
Is version ofhttps://doi.org/10.5964/ps.6029
-
Is version ofhttps://doi.org/10.23668/psycharchives.12453
-
Is related tohttps://doi.org/10.23668/psycharchives.12453
-
Is related tohttps://doi.org/10.23668/psycharchives.5652
-
Keyword(s)reproducibilityen_US
-
Keyword(s)credibilityen_US
-
Keyword(s)research evaluationen_US
-
Keyword(s)assessmenten_US
-
Keyword(s)qualityen_US
-
Keyword(s)metricsen_US
-
Keyword(s)publicationen_US
-
Dewey Decimal Classification number(s)150
-
TitleTen steps toward a better personality science – how quality may be rewarded more in research evaluationen_US
-
DRO typearticleen_US
-
Journal titlePersonality Science
-
Visible tag(s)PsychOpen GOLDen_US
-
Visible tag(s)Accepted Manuscripten_US