Show simple item record

Multidimensional Signals and Analytic Flexibility: Estimating Degrees of Freedom in Human-Speech Analyses

dc.contributor.authorCORETTA, Stefano
dc.contributor.authorCASILLAS, Joseph
dc.contributor.authorROESSIG, Simon
dc.contributor.authorFRANKE, Michael
dc.contributor.authorAHN, Byron
dc.contributor.authorAL-HOORIE, Ali
hal.structure.identifierLaboratoire de Linguistique Formelle [LLF - UMR7110]
dc.contributor.authorAL-TAMIMI, Jalal
dc.contributor.authorALOTAIBI, Najd
dc.contributor.authorALSHAKHORI, Mohammed
dc.contributor.authorALTMILLER, Ruth
dc.contributor.authorARANTES, Pablo
dc.contributor.authorATHANASOPOULOU, Angeliki
dc.contributor.authorBAESE-BERK, Melissa
dc.contributor.authorBAILEY, George
dc.contributor.authorSANGMA, Cheman Baira A
dc.contributor.authorBEIER, Eleonora
dc.contributor.authorBENAVIDES, Gabriela
dc.contributor.authorBENKER, Nicole
dc.contributor.authorBENSONMEYER, Emelia
dc.contributor.authorBENWAY, Nina
dc.contributor.authorBERRY, Grant
dc.contributor.authorBING, Liwen
dc.contributor.authorBJORNDAHL, Christina
dc.contributor.authorBOLYANATZ, Mariška
dc.contributor.authorBRAVER, Aaron
dc.contributor.authorBROWN, Violet
dc.contributor.authorBROWN, Alicia
dc.contributor.authorBRUGOS, Alejna
dc.contributor.authorBUCHANAN, Erin
dc.contributor.authorBUTLIN, Tanna
dc.contributor.authorBUXÓ-LUGO, Andrés
dc.contributor.authorCAILLOL, Coline
dc.contributor.authorCANGEMI, Francesco
dc.contributor.authorCARIGNAN, Christopher
dc.contributor.authorCARRATURO, Sita
dc.contributor.authorCAUDRELIER, Tiphaine
dc.contributor.authorCHODROFF, Eleanor
dc.contributor.authorCOHN, Michelle
dc.contributor.authorCRONENBERG, Johanna
dc.contributor.authorCROUZET, Olivier
dc.contributor.authorDAGAR, Erica
dc.contributor.authorDAWSON, Charlotte
dc.contributor.authorDIANTORO, Carissa
dc.contributor.authorDOKOVOVA, Marie
dc.contributor.authorDRAKE, Shiloh
dc.contributor.authorDU, Fengting
dc.contributor.authorDUBUIS, Margaux
dc.contributor.authorDUÊME, Florent
dc.contributor.authorDURWARD, Matthew
hal.structure.identifierCentre de recherche sur la langue et les textes basques [IKER]
dc.contributor.authorEGURTZEGI, Ander
dc.contributor.authorELSHERIF, Mahmoud
dc.contributor.authorESSER, Janina
dc.contributor.authorFERRAGNE, Emmanuel
dc.contributor.authorFERREIRA, Fernanda
dc.contributor.authorFINK, Lauren
dc.contributor.authorFINLEY, Sara
dc.contributor.authorFOSTER, Kurtis
dc.contributor.authorFOULKES, Paul
dc.contributor.authorFRANZKE, Rosa
dc.contributor.authorFRAZER-MCKEE, Gabriel
dc.contributor.authorFROMONT, Robert
dc.contributor.authorGARCÍA, Christina
dc.contributor.authorGELLER, Jason
dc.contributor.authorGRASSO, Camille
dc.contributor.authorGRECA, Pia
dc.contributor.authorGRICE, Martine
dc.contributor.authorGROSE-HODGE, Magdalena
dc.contributor.authorGULLY, Amelia
dc.contributor.authorHALFACRE, Caitlin
dc.contributor.authorHAUSER, Ivy
dc.contributor.authorHAY, Jen
dc.contributor.authorHAYWOOD, Robert
dc.contributor.authorHELLMUTH, Sam
dc.contributor.authorHILGER, Allison
dc.contributor.authorHOLLIDAY, Nicole
dc.contributor.authorHOOGLAND, Damar
dc.contributor.authorHUANG, Yaqian
dc.contributor.authorHUGHES, Vincent
dc.contributor.authorICARDO ISASA, Ane
dc.contributor.authorILCHOVSKA, Zlatomira
dc.contributor.authorJEON, Hae-Sung
dc.contributor.authorJONES, Jacq
dc.contributor.authorJUNGES, Mágat
dc.contributor.authorKAEFER, Stephanie
dc.contributor.authorKALAND, Constantijn
dc.contributor.authorKELLEY, Matthew
dc.contributor.authorKELLY, Niamh
dc.contributor.authorKETTIG, Thomas
dc.contributor.authorKHATTAB, Ghada
dc.contributor.authorKOOLEN, Ruud
dc.contributor.authorKRAHMER, Emiel
dc.contributor.authorKRAJEWSKA, Dorota
dc.contributor.authorKRUG, Andreas
dc.contributor.authorKUMAR, Abhilasha
dc.contributor.authorLANDER, Anna
dc.contributor.authorLENTZ, Tomas
dc.contributor.authorLI, Wanyin
dc.contributor.authorLI, Yanyu
dc.contributor.authorLIALIOU, Maria
dc.contributor.authorLIMA, Ronaldo
dc.contributor.authorLO, Justin
dc.contributor.authorLOPEZ OTERO, Julio Cesar
dc.contributor.authorMACKAY, Bradley
dc.contributor.authorMACLEOD, Bethany
dc.contributor.authorMALLARD, Mel
dc.contributor.authorMCCONNELLOGUE, Carol-Ann Mary
dc.contributor.authorMOROZ, George
dc.contributor.authorMURALI, Mridhula
dc.contributor.authorNALBORCZYK, Ladislas
dc.contributor.authorNENADIĆ, Filip
dc.contributor.authorNIEDER, Jessica
dc.contributor.authorNIKOLIĆ, Dušan
dc.contributor.authorNOGUEIRA, Francisco
dc.contributor.authorOFFERMAN, Heather
dc.contributor.authorPASSONI, Elisa
hal.structure.identifierCentre de Linguistique Inter-langues, de Lexicologie, de Linguistique Anglaise et de Corpus [CLILLAC-ARP (URP_3967)]
dc.contributor.authorPÉLISSIER, Maud
dc.contributor.authorPERRY, Scott
dc.contributor.authorPFIFFNER, Alexandra
dc.contributor.authorPROCTOR, Michael
dc.contributor.authorRHODES, Ryan
dc.contributor.authorRODRÍGUEZ, Nicole
dc.contributor.authorROEPKE, Elizabeth
dc.contributor.authorRÖER, Jan
dc.contributor.authorSBACCO, Lucia
dc.contributor.authorSCARBOROUGH, Rebecca
dc.contributor.authorSCHAEFFLER, Felix
dc.contributor.authorSCHLEEF, Erik
dc.contributor.authorSCHMITZ, Dominic
dc.contributor.authorSHIRYAEV, Alexander
dc.contributor.authorSÓSKUTHY, Márton
dc.contributor.authorSPANIOL, Malin
dc.contributor.authorSTANLEY, Joseph
dc.contributor.authorSTRICKLER, Alyssa
dc.contributor.authorTAVANO, Alessandro
dc.contributor.authorTOMASCHEK, Fabian
dc.contributor.authorTUCKER, Benjamin
dc.contributor.authorTURNBULL, Rory
dc.contributor.authorUGWUANYI, Kingsley
dc.contributor.authorURRESTARAZU-PORTA, Iñigo
dc.contributor.authorVAN DE VIJVER, Ruben
dc.contributor.authorVAN ENGEN, Kristin
dc.contributor.authorVAN MILTENBURG, Emiel
dc.contributor.authorWANG, Bruce Xiao
dc.contributor.authorWARNER, Natasha
dc.contributor.authorWEHRLE, Simon
dc.contributor.authorWESTERBEEK, Hans
dc.contributor.authorWIENER, Seth
dc.contributor.authorWINTERS, Stephen
dc.contributor.authorWONG, Sidney G.-J.
dc.contributor.authorWOOD, Anna
hal.structure.identifierLaboratoire d'Informatique de l'Université du Mans [LIUM]
dc.contributor.authorWOTTAWA, Jane
dc.contributor.authorXU, Chenzi
dc.contributor.authorZÁRATE-SÁNDEZ, Germán
dc.contributor.authorZELLOU, Georgia
dc.contributor.authorZHANG, Cong
dc.contributor.authorZHU, Jian
dc.contributor.authorROETTGER, Timo
dc.date.issued2023-07
dc.identifier.issn2515-2459
dc.description.abstractEnRecent empirical studies have highlighted the large degree of analytic flexibility in data analysis that can lead to substantially different conclusions based on the same data set. Thus, researchers have expressed their concerns that these researcher degrees of freedom might facilitate bias and can lead to claims that do not stand the test of time. Even greater flexibility is to be expected in fields in which the primary data lend themselves to a variety of possible operationalizations. The multidimensional, temporally extended nature of speech constitutes an ideal testing ground for assessing the variability in analytic approaches, which derives not only from aspects of statistical modeling but also from decisions regarding the quantification of the measured behavior. In this study, we gave the same speech-production data set to 46 teams of researchers and asked them to answer the same research question, resulting in substantial variability in reported effect sizes and their interpretation. Using Bayesian meta-analytic tools, we further found little to no evidence that the observed variability can be explained by analysts’ prior beliefs, expertise, or the perceived quality of their analyses. In light of this idiosyncratic variability, we recommend that researchers more transparently share details of their analysis, strengthen the link between theoretical construct and quantitative system, and calibrate their (un)certainty in their conclusions.
dc.language.isoen
dc.publisher[Thousand Oaks]: [SAGE Publications]
dc.rights.urihttp://creativecommons.org/licenses/by-nc/
dc.subject.encrowdsourcing science
dc.subject.endata analysis
dc.subject.enscientific transparency
dc.subject.enspeech
dc.subject.enacoustic analysis
dc.title.enMultidimensional Signals and Analytic Flexibility: Estimating Degrees of Freedom in Human-Speech Analyses
dc.typeArticle de revue
dc.identifier.doi10.1177/25152459231162567
dc.subject.halSciences cognitives
bordeaux.journalAdvances in Methods and Practices in Psychological Science
bordeaux.page1-29
bordeaux.volume6
bordeaux.issue3
bordeaux.peerReviewedoui
hal.identifierhal-04230571
hal.version1
hal.popularnon
hal.audienceInternationale
hal.origin.linkhttps://hal.archives-ouvertes.fr//hal-04230571v1
bordeaux.COinSctx_ver=Z39.88-2004&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.jtitle=Advances%20in%20Methods%20and%20Practices%20in%20Psychological%20Science&rft.date=2023-07&rft.volume=6&rft.issue=3&rft.spage=1-29&rft.epage=1-29&rft.eissn=2515-2459&rft.issn=2515-2459&rft.au=CORETTA,%20Stefano&CASILLAS,%20Joseph&ROESSIG,%20Simon&FRANKE,%20Michael&AHN,%20Byron&rft.genre=article


Files in this item

FilesSizeFormatView

There are no files associated with this item.

This item appears in the following Collection(s)

Show simple item record