Please use this identifier to cite or link to this item: http://dx.doi.org/10.23668/psycharchives.2354
Full metadata record
DC FieldValueLanguage
dc.rights.licenseCC-BY-SA 4.0en_US
dc.contributor.authorPargent, Florian-
dc.date.accessioned2019-01-22T12:56:56Z-
dc.date.available2019-01-22T12:56:56Z-
dc.date.issued2019-
dc.identifier.citationPargent, F. (2019). Estimating the Performance of Predictive Models with Resampling Methods. PsychArchives. https://doi.org/10.23668/psycharchives.2354en
dc.identifier.urihttps://hdl.handle.net/20.500.12034/1986-
dc.identifier.urihttp://dx.doi.org/10.23668/psycharchives.2354-
dc.identifier.urihttps://youtu.be/B2oOn0FdRwo-
dc.description.abstractMachine learning methodology is gaining popularity in psychology and other social sciences. One core element is how to estimate the accuracy of individual predictions when applying a predictive model to new observations in practice. In this talk, Dr. Florian Pargent will give an introduction on how such an evaluation of predictive performance is achieved by resampling methods like k-fold cross-validation. Specifically, he will demonstrate why such out-of-sample estimates of predictive performance are necessary when working with machine learning algorithms (e.g. Random Forests). Then, it will be discussed whether resampling methods should be more frequently used when evaluating linear regression models which are predominantly used in psychological science. Finally, Dr. Florian Pargent will outline common pitfalls in evaluating model performance, that can lead to gross overestimates of predictive accuracy in the literature when preprocessing steps like variable selection are not adequately combined with the resampling scheme.-
dc.description.abstractPresentation within the frame of the ZPID Colloquium, 16 January 2019-
dc.language.isoengen_US
dc.publisherPsychArchivesen_US
dc.relation.ispartofZPID-Kolloquium 2019, Trier, Germanyen_US
dc.relation.isversionofhttps://osf.io/a8qbt/-
dc.rightsopenAccessen_US
dc.rights.urihttps://creativecommons.org/licenses/by-sa/4.0/en_US
dc.subject.ddc150-
dc.titleEstimating the Performance of Predictive Models with Resampling Methodsen_US
dc.typeconferenceObjecten_US
Appears in Collections:Conference Object

Files in This Item:
File Description SizeFormat 
presentation.pdf705,8 kBAdobe PDF Preview PDFDownload


This item is licensed under a Creative Commons License Creative Commons