Examining the generalizability of research findings from archival data
Publication year
2022Author(s)
Number of pages
9 p.
Source
Proceedings of the National Academy of Sciences USA, 119, 30, (2022), article e2120377119ISSN
Publication type
Article / Letter to editor
Display more detailsDisplay less details
Organization
SW OZ RSCR SOC
SW OZ BSI AO
Journal title
Proceedings of the National Academy of Sciences USA
Volume
vol. 119
Issue
iss. 30
Languages used
English (eng)
Subject
Inequality, cohesion and modernization; Work, Health and Performance; Ongelijkheid, cohesie en moderniseringAbstract
This initiative examined systematically the extent to which a large set of archival research findings generalizes across contexts. We repeated the key analyses for 29 original strategic management effects in the same context (direct reproduction) as well as in 52 novel time periods and geographies; 45% of the reproductions returned results matching the original reports together with 55% of tests in different spans of years and 40% of tests in novel geographies. Some original findings were associated with multiple new tests. Reproducibility was the best predictor of generalizability - for the findings that proved directly reproducible, 84% emerged in other available time periods and 57% emerged in other geographies. Overall, only limited empirical evidence emerged for context sensitivity. In a forecasting survey, independent scientists were able to anticipate which effects would find support in tests in new samples.
This item appears in the following Collection(s)
- Academic publications [244127]
- Electronic publications [131133]
- Faculty of Social Sciences [30028]
- Open Access publications [105176]
Upload full text
Use your RU credentials (u/z-number and password) to log in with SURFconext to upload a file for processing by the repository team.