Meta-Analysis of Social Science Research: A Practitioner’s Guide

Meta-Analysis of Social Science Research: A Practitioner’s Guide

Authors:

Prof. PhDr. Tomáš Havránek Ph.D.
doc. PhDr. Zuzana Havránková Ph.D.
T.D. Stanley
Hristos Doucouliagos

Type: IES Working Papers
Year: 2023
Number: 25
ISSN / ISBN:  
Published on: IES Working Papers 25/2023
Publishing place: Praha
Keywords: meta-analysis, publication bias, p-hacking, artificial intelligence, model uncertainty
JEL codes: A14, B49, C83
Suggested citation: Irsova Z., Doucouliagos H., Havranek T., Stanley T.D. (2023): " Meta-Analysis of Social Science Research: A Practitioner’s Guide" IES Working Papers 25/2023. IES FSV. Charles University.
Abstract: This paper provides concise, nontechnical, step-by-step guidelines on how to conduct a modern meta-analysis, especially in social sciences. We treat publication bias, p-hacking, and heterogeneity as phenomena meta-analysts must always confront. To this end, we provide concrete methodological recommendations. Meta-analysis methods have advanced notably over the last few years. Yet many meta-analyses still rely on outdated approaches, some ignoring publication bias and systematic heterogeneity. While limitations persist, recently developed techniques allow robust inference even in the face of formidable problems in the underlying empirical literature. The purpose of this paper is to summarize the state of the art in a way accessible to aspiring meta-analysts in any field. We also discuss how meta-analysts can use advances in artificial intelligence to work more efficiently.
Download: wp_2023_25_irsova, doucouliagos, havranek, stanley