Truth and transparency in expertise research

Article

Searston, Rachel A., Thompson, Matthew B., Robson, Samuel G., Corbett, Brooklyn J., Ribeiro, Gianni, Edmond, Gary and Tangen, Jason M.. 2019. "Truth and transparency in expertise research ." Journal of Expertise. 2 (4), pp. 199-209.
Article Title

Truth and transparency in expertise research

ERA Journal ID213238
Article CategoryArticle
AuthorsSearston, Rachel A., Thompson, Matthew B., Robson, Samuel G., Corbett, Brooklyn J., Ribeiro, Gianni, Edmond, Gary and Tangen, Jason M.
Journal TitleJournal of Expertise
Journal Citation2 (4), pp. 199-209
Number of Pages11
Year2019
PublisherMichigan State University Press
Place of PublicationUnited States
ISSN2573-2773
Web Address (URL)https://www.journalofexpertise.org/articles/volume2_issue4/JoE_2_4_Searston.html
Abstract

Across research areas, general issues of low statistical power, publication bias, undisclosed flexibility in data analysis, and researcher degrees of freedom, can be recipes for irreproducibility. To address the problem, a reform movement known as the “credibility revolution” emphasizes the need for greater transparency in how research is conducted. In this article, we describe a general approach to creating a culture of openness—tailored for expertise researchers—and describe how and why practices such as preregistration, open notebooks, open data, open materials, and open communication, might be applied to research on experts. We argue that adopting these practices helps to connect end-users with the entire research lifecycle and helps reconnect researchers with the process of gaining knowledge. By sharing notes about our predictions and plans along the way, we are forced to confront their merits. By documenting design and data analytic decisions ahead of time, and by sharing data and materials, we make errors and insights more discoverable. And by inviting research partners, expert practitioners, and the public into the lab, we stand the best chance of successfully translating research into practice.

KeywordsExpertise; open science; preregistration; reproducibility; cognitive psychology
ANZSRC Field of Research 2020529999. Other psychology not elsewhere classified
Byline AffiliationsUniversity of Adelaide
Murdoch University
University of Queensland
University of New South Wales
Permalink -

https://research.usq.edu.au/item/yzyq0/truth-and-transparency-in-expertise-research

Log in to edit

Download files

Published Version
JoE_2_4_Searston.pdf
License: CC BY 4.0
File access level: Anyone

  • 77
    total views
  • 47
    total downloads
  • 0
    views this month
  • 0
    downloads this month

Export as

Related outputs

Author Correction: Self-administered mindfulness interventions reduce stress in a large, randomized controlled multi-site study
Sparacio, Alessandro, Ijzerman, Hans, Ropovik, Ivan, Giorgini, Filippo, Spiessens, C.Spiessens, Christoph, Uchino, Bert N., Landvatter, Joshua, Tacana, Tracey, Diller, Sandra J., Derrick, Jaye L., Segundo, Joahana, Pierce, Jace D., Ross, Robert M., Francis, Zoë, LaBoucane, Amanda, Ma-Kellams, Christine, Ford, Maire B., Schmidt, Kathleen, Wong, Celia C., ..., Jiga-Boy, Gabriela M.. 2024. "Author Correction: Self-administered mindfulness interventions reduce stress in a large, randomized controlled multi-site study ." Nature Human Behaviour. 8. https://doi.org/10.1038/s41562-024-01947-z
Jurors’ perceptions of transgender victims of sexual assault: A literature review of empirical research and policy review of judicial instructions
Ribeiro, Gianni and Nitschke, Faye T.. 2024. "Jurors’ perceptions of transgender victims of sexual assault: A literature review of empirical research and policy review of judicial instructions." Behavioral Sciences and the Law. https://doi.org/10.1002/bsl.2694
Self-administered mindfulness interventions reduce stress in a large, randomized controlled multi-site study
Sparacio, Alessandro, Ijzerman, Hans, Ropovik, Ivan, Giorgini, Filippo, Spiessens, Christoph, Uchino, Bert N., Landvatter, Joshua, Tacana, Tracey, Diller, Sandra J., Derrick, Jaye L., Segundo, Joahana, Pierce, Jace D., Ross, Robert M., Francis, Zoë, LaBoucane, Amanda, Ma-Kellams, Christine, Ford, Maire B., Schmidt, Kathleen, Wong, Celia C., ..., Jiga-Boy, Gabriela M.. 2024. "Self-administered mindfulness interventions reduce stress in a large, randomized controlled multi-site study." Nature Human Behaviour. https://doi.org/10.1038/s41562-024-01907-7
Most states now have affirmative sexual consent laws, but not enough people know what they mean
Crowe, Jonathan and Ribeiro, Gianni. 2024. "Most states now have affirmative sexual consent laws, but not enough people know what they mean." The Conversation.
The impact of misinformation presented during jury deliberation on juror memory and decision-making
Cullen, Hayley J., Dilevski, Natali, Nitschke, Faye T., Ribeiro, Gian, Brind, Shobanah and Woolley, Nikita. 2024. "The impact of misinformation presented during jury deliberation on juror memory and decision-making." Frontiers in Psychology. 15. https://doi.org/10.3389/fpsyg.2024.1232228
Visual decision aids: Improving laypeople’s understanding of forensic science evidence
Ribeiro, Gianni, Likwornik, Helena and Chin, Jason M.. 2023. "Visual decision aids: Improving laypeople’s understanding of forensic science evidence ." Journal of Applied Research in Memory and Cognition. 12 (2), pp. 230-240. https://doi.org/10.1037/mac0000026
Diagnostic information produces better-calibrated judgments about forensic comparison evidence than likelihood ratios
Ribeiro, Gianni, McKimmie, Blake Malcolm and Tangen, Jason Marcus. 2023. "Diagnostic information produces better-calibrated judgments about forensic comparison evidence than likelihood ratios." Journal of Applied Research in Memory and Cognition. 12 (3), pp. 412-420. https://doi.org/10.1037/mac0000062
Glossary
Irvine, Sarah, McGregor, Rowena, Thangavelu, Anbarasu, Fahey, Kacie, Thompson, Matthew and Jackson, Charlene. 2021. "Glossary." Hargreaves, Wendy, Bartlett, Cristy and Derrington, Kate (ed.) Academic Success. University of Southern Queensland. pp. 294-298
A Multi-Site Collaborative Study of the Hostile Priming Effect
McCarthy, Randy, Gervais, Will, Aczel, Balazs, Al-Kire, Rosemary L., Aveyard, Mark, Marcella Baraldo, Silvia, Baruh, Lemi, Basch, Charlotte, Baumert, Anna, Behler, Anna, Bettencourt, Ann, Bitar, Adam, Bouxom, Hugo, Buck, Ashley, Cemalcilar, Zeynep, Chekroun, Peggy, Chen, Jacqueline M., del Fresno-Díaz, Ángel, Ducham, Alec, ..., Zogmaister, C.. 2021. "A Multi-Site Collaborative Study of the Hostile Priming Effect." Collabra: Psychology. 7 (1). https://doi.org/10.1525/collabra.18738
To which world regions does the valence-dominance model of social perception apply?
Jones, Benedict C., DeBruine, Lisa Marie, Flake, Jessica K., Liuzza, Marco Tullio, Antfolk, Jan, Arinze, Nwadiogo C., Ndukaihe, Izuchukwu L. G., Bloxsom, Nicholas G., Lewis, Savannah, Foroni, Francesco, Willis, Megan L., Cubillas, Carmelo P., Vadillo, Miguel A., Turiegano, Enrique, Gilead, Michael, Simchon, Almog, Saribay, S. Adil, Owsley, Nicholas C., Jang, Chaning, ..., Coles, Nicholas A.. 2021. "To which world regions does the valence-dominance model of social perception apply?" Nature Human Behaviour. 5 (1), pp. 159-169. https://doi.org/10.1038/s41562-020-01007-2
Does DNA evidence in the form of a likelihood ratio affect perceivers’ sensitivity to the strength of a suspect’s alibi?
Ribeiro, Gianni, Tangen, Jason and McKimmie, Blake. 2020. "Does DNA evidence in the form of a likelihood ratio affect perceivers’ sensitivity to the strength of a suspect’s alibi? " Psychonomic Bulletin and Review. 27 (6), pp. 1325-1332. https://doi.org/10.3758/s13423-020-01784-x
Open forensic science
Chin, Jason M, Ribeiro, Gianni and Rairden, Alicia. 2019. "Open forensic science." Journal of Law and the Biosciences. 6 (1), pp. 255-288. https://doi.org/10.1093/jlb/lsz009
Beliefs about error rates and human judgment in forensic science
Ribeiro, Gianni, Tangen, Jason M. and McKimmie, Blake M. 2019. "Beliefs about error rates and human judgment in forensic science." Forensic Science International. 297 (1), pp. 138-147. https://doi.org/10.1016/j.forsciint.2019.01.034
Investigating the impact of jury sentencing recommendations using procedural justice theory
Ribeiro, Gianni and Antrobus, Emma. 2017. "Investigating the impact of jury sentencing recommendations using procedural justice theory." New Criminal Law Review: an international and interdisciplinary journal. 20 (4), pp. 535-568. https://doi.org/10.1525/nclr.2017.20.4.535
Thinking forensics: Cognitive science for forensic practitioners
Edmond, Gary, Towler, Alice, Growns, Bethany, Ribeiro, Gianni, Found, Bryan, White, David, Ballantyne, Kaye, Searston, Rachel A., Thompson, Matthew B., Tangen, Jason M., Kemp, Richard I. and Martire, Kristy. 2017. "Thinking forensics: Cognitive science for forensic practitioners." Science and Justice. 57 (2), pp. 144-154. https://doi.org/10.1016/j.scijus.2016.11.005
Model forensic science
Edmond, Gary, Found, Bryan, Martire, Kristy, Ballantyne, Kaye, Hamer, David, Searston, Rachel, Thompson, Matthew, Cunliffe, Emma, Kemp, Richard, San Roque, Mehera, Tangen, Jason, Dioso-Villa, Rachel, Ligertwood, Andrew, Hibbert, David, White, David, Ribeiro, Gianni, Porter, Glenn, Towler, Alice and Roberts, Andrew. 2016. "Model forensic science." Australian Journal of Forensic Sciences. 48 (5), pp. 496-537. https://doi.org/10.1080/00450618.2015.1128969