Meta-Analysis for Public Management and Policy

ISBN-13: 9781118190135 / Angielski / Miękka / 2012 / 592 str.

Evan Ringquist

Opis

Praise for Meta-Analysis for Public Management and Policy

-In his usual rigorous but readable style, Evan Ringquist and co-author Mary Anderson have produced a tour-de-force on the topic of meta-analysis in public policy and management research. Meta-analysis is badly needed in the all-too-common situation when researchers have low confidence in summarizing the overall results of dozens of studies on the effectiveness of some policy. This book has a nice combination of conceptual overview, methodological details, and applications that will make it possible for researchers to conduct their own meta-analysis. It is tempting to require all graduate students to write a meta-analysis as a chapter in their dissertation, or include meta-analysis as a standard offering in the research methods curriculum of social science graduate programs. The more people that adopt Ringquist and Anderson's approach, the less resources will be wasted on conducting studies that do not contribute to cumulative scientific knowledge. -
--Mark Lubell
Department of Environmental Science and Policy
Director, Center for Environmental Policy and Behavior University of California-Davis -Ringquist and his colleagues deliver value and add to canon of public management methods by delivering an analytical framework that makes the case for systematic research using the tools of meta-analysis. This book will be a must read for all committed to strengthening evidence-based research that improves public policy and management decision making.-
--David M. Van Slyke
The Maxwell School of Citizenship and Public Affairs Syracuse University -In Meta-Analysis for Public Management and Policy Evan Ringquist and his colleagues provide a lucid and practical roadmap for policy and public management scholars who use meta-analysis in their research. But this is more than a -how to- volume; it provides background on why meta-analysis is a potent means for accumulating and synthesizing empirical research findings, and shows how its use has evolved in recent decades. Specific applications of meta-analysis to long-standing policy and management debates are given, essentially providing an array of developed -templates- through which scholars and practitioners can assess how to approach different kinds of analytical problems using meta-analysis. Particularly valuable to me is the careful development and presentation of the necessary stages of meta-analysis, from conceptualization through data coding and bias assessment to advanced modeling. All of the statistical analyses can be conducted in Stata, utilizing readily available -.ado- modules. I will use this book, both in research and in the classroom. Overall it is one of the most useful methodological contributions I've seen in some time.-
--Hank Jenkins-Smith
Department of Political Science Director, Center for Applied Social Research University of Oklahoma -Meta-Analysis for Public Management and Policy conveys the considerable untapped potential of meta-analysis to strengthen and advance bodies of knowledge and evidence in public management and policy. This book takes students and researchers deep into the methods of meta-analysis and details of their empirical application, without losing sight of the important policy questions and the implications of choices that researchers make in their empirical work for the production of evidence for public managers and policymakers. This book will serve as an excellent practical guide for those conducting their first meta-analysis, while at the same time supporting critically-focused consumption of existing meta-analyses and discussion of where the field can gainfully take this approach to enhance our research and knowledge bases. It draws in a range of valuable and important examples of applications of meta-analysis techniques throughout the book and rounds off with four full-fledged applications of the method. Although the book reaches out to an audience of public management and policy researchers and consumers of this research, it should be of interest to a broad range of applied social science researchers and students as well.-
--Carolyn Heinrich
Sid Richardson Professor of Public Affairs Director, Center for Health and Social Policy LBJ School of Public Affairs University of Texas - Austin -Even for incredibly specialized techniques, public management and policy scholars have a multiplicity of methods texts from which to choose. Yet it is truly surprising that a strong guide to applied meta-analysis -- a rigorous framework for the organization of empirical findings -- has not been available. Ringquist and Anderson provided just that with an accessible guide to sophisticated techniques. Marrying an instructive text to a set of exemplary standalone studies, Meta-Analysis for Public Management and Policy offers unparalleled guidance for instructors and students and more than a little wisdom for seasoned scholars. It is destined to become the standard reference for our field.-
--Anthony Michael Bertelli
CC Crawford Chair in Management and Performance USC Price School of Public Policy USC Gould School of Law University of Southern California -This comprehensive treatment of meta-analysis is an excellent guide for scholars and students in public management and public policy. The carefully done exposition demonstrates why meta-analysis should have greater use in the profession.-
--Kenneth J. Meier
Charles H. Gregory Chair in Liberal Arts Department of Political Science Texas A&M University -This remarkable book reviews the history of the use of meta-analysis in the social sciences, argues forcefully for its importance, value, and relevance for public managers, and provides one-stop-shopping for those who want to learn how to do it or understand how others have done it. The detailed coverage of each step in the process allo

Spis treści

Figures, Tables, and Exhibit ix

Preface xv

The Authors xxi

Introducing: Meta–Analysis for Public Management and Policy 1
Evan J. Ringquist and Mary R. Anderson

Introducing Meta–Analysis 4

The Institutionalization of Meta–Analysis 5

A Role for Meta–Analysis in Public Management and Policy 9

Meta–Analysis: Understanding the Basics 17

Adapting Meta–Analysis for Public Management and Policy 31

Conclusion 34

PART ONE: TECHNIQUES OF META–ANALYSIS 37

1 Conceptualizing Research and Gathering Studies 39
Evan J. Ringquist

Conceptualizing a Meta–Analysis 40

Conducting a Literature Search in Meta–Analysis 50

Conclusion 66

2 Turning Studies into Data 68
Evan J. Ringquist

What to Code 70

The Process of Coding 85

Conclusion 97

3 Calculating and Combining Effect Sizes 102
Evan J. Ringquist

Calculating Effect Sizes 103

Fixed Effects and Random Effects Meta–Analysis 118

Combining Effect Sizes 124

Conclusion 137

4 Meta–Regression Analysis 141
Evan J. Ringquist

Historical Development of Meta–Regression 142

Designing a Meta–Regression 144

Fixed Effects Meta–Regression 151

Random EffectsMeta–Regression 171

Conclusion 189

5 Advanced Meta–Regression for Public Management and Policy 191
Evan J. Ringquist

Clustered Robust Estimation in Meta–Regression 193

Alternatives for Addressing Dependence in Meta–Regression 207

Conclusion 229

6 PublicationBias 231
Evan J. Ringquist

Sources and Consequences of Publication Bias 232

Identifying Publication Bias 238

Remedying and Preventing Publication Bias 253

Conclusion 266

7 Meta–Analysis in Economics 268
Evan J. Ringquist

The FAT–MST–PET–MRA Approach to Meta–Regression 269

Assessing the FAT as a Test for Publication Bias 272

Identifying True Effects Using the MST 291

Estimating the Magnitude of True Effects Using the PET 292

Conclusion 307

PART TWO: META–ANALYSIS IN PUBLIC MANAGEMENT AND POLICY RESEARCH 309

8 Evaluating the Effectiveness of Educational Vouchers 311
Mary R. Anderson, Tatyana Guzman and Evan J. Ringquist

School Choice and Educational Vouchers 312

The Effectiveness of Educational Vouchers 318

Designing a Meta–Analysis of Voucher Effects 324

Searching the Literature 331

Data Analysis: Synthesis 335

Meta–Regression Analysis 339

Conclusion 348

Studies Coded for Meta–Analysis 349

9 Performance Management in the Public Sector 352
Ed Gerrish and Po–Ju Wu

Origin of Performance Management 354

Performance Management in the Literature 359

Literature Search 368

Data Analysis: Synthesis 372

Meta–Analytic Regression Analysis 379

Conclusion 390

Studies Coded for Meta–Analysis 393

Addendum: StratifiedMeta–Regression of Compstat and Compstat–Like Programs 394

10 The Effects of Federal Poverty Deconcentration Efforts on Economic Self–Sufficiency and Problematic Behaviors 398
Joe Bolinger and Lanlan Xu

History of Poverty Deconcentration Programs in the United States 399

Theoretical Foundations of Poverty Deconcentration Policies 402

Impacts of Poverty Deconcentration Policies on Individual Economic and Behavioral Life Outcomes 408

Literature Search 413

Analysis 416

Meta–Regression Analysis 426

Conclusion 436

Studies Coded for Meta–Analysis 439

11 The Relationship Between Public Service Motivation and Performance 442
David C. Warren and Li–Ting Chen

The Importance of a Possible PSM–Performance Relationship 443

Theoretical Foundations of the PSM–Performance Relationship 444

Framing the Meta–Analysis of the PSM–Performance Relationship 447

Data Analysis 455

Meta–Regression Analysis 462

Conclusion 468

Studies Coded for Meta–Analysis 473

Conclusion: Meta–Analysis and the Future of Research in Public Management and Policy 475
Mary R. Anderson and Evan J. Ringquist

Why Meta–Analysis? 478

Why Meta–Analysis Now? 480

Meta–Analysis for Public Management and Policy: An Adaptation 481

A World of Possibilities: The Future of Meta–Analysis in Public Management and Policy 484

Appendix: Coding Sheets 487

A1: School Vouchers 488

A2: Performance Management 494

A3: Public Housing 502

A4: Public Service Motivation 508

References 514

Name Index 543

Subject Index 549

O autorze

Evan J. Ringquist is professor and director of the Ph.D. programs in Public Affairs and Public Policy in the School of Public and Environmental Affairs at Indiana University.

Blurb

Meta–Analysis for Public Management and Policy is a groundbreaking book that includes a proven set of tools for making sense of mountains of sometimes inconsistent conclusions from original research. The tools of meta–analysis can help to improve scholarship, ensure more accurate tests of theories, provide clearer and more authoritative advice for policy and management, and ultimately contribute to the wider knowledge base of public management and policy and the social sciences more broadly.

This important resource contains an in–depth explanation of the six–stage process for conducting a meta–analysis which consists of Scoping, Literature Search, Data Coding, Calculating and Combining Effect Sizes, Explaining Differences in Effect Sizes Across Original Studies, and Identifying Areas for Further Research. The text includes detailed explanations of the statistical approaches to meta–analysis that have been found to be most useful to researchers and practitioners in public management and policy, and offers four original meta–analyses of school vouchers, performance measurement, public housing decentralization, and public service motivation. These original studies (conducted by the author and his team) offer step–by–step templates for how to conduct a meta–analysis while also contributing original research on important issues in public management and policy.

Meta–Analysis for Public Management and Policy is the hands–on resource that can help students and professionals improve the quality and the relevance of research in public management and policy.