Program Evaluation Prism

ISBN-13: 9780470579046 / Angielski / Miękka / 2010 / 324 str.

Martin Abbott

Opis

This book is a comprehensive treatment of correlation/regression techniques and using SPSS for interpretation of findings. Striking a balance between detailed coverage and approachability, this book provides a thorough treatment of the elements of regression and how they can be used with real research problems in program evaluation. The author begins with a basic introduction to evaluation methodology, and its ability to recognize embedded patterns of meaning in research data. Subsequent chapters explore the statistical tools that can be applied by researchers and evaluators irrespective of the design that was used to generate this data. Topics of coverage include: correlation, single predictor regression, multiple correlation, part and partial correlation, detection of extreme scores, multiple regression, regression with continuous predictors, coding of categorical data, regression with categorical predictors, methods for entering predictors in multiple regression, and interaction in multiple regression. Each chapter is presented in the same comprehensive format: an introduction to the topic, followed by a discussion of its primary elements, illustrations of the data through numerous tables and figures, SPSS procedures for designing the analysis, SPSS output of the analysis, and guidance on how to interpret findings from the analyses. Discover Note and Research Steps sections illustrate how using statistical processes can unveil unobserved patterns and assist readers with identifying such patterns in their own data. Real-world analyses are used throughout the book, utilizing meaningful social issues as a catalyst for teaching statistical procedures, and a related Web site features additional data sets, solutions, and research projects for readers.

Spis treści

CHAPTER ONE: INTRODUCTION.

Initial Considerations.

Book Plan.

Real Examples.

Using Statistical Programs.

The Evaluator s Journey.

CHAPTER TWO: THE ELEMENTS OF EVALUATION.

Nature of Evaluation.

Evaluation Concerns.

Evaluation Standards.

Methods used in Evaluation.

The Evaluator s Tools.

Evaluation Hurdles.

Quantification.

Resistance to Quantification.

The Nature of Quantification.

Qualitative Methods.

Specialization.

Statistical Issues.

Certainty vs. Probability.

Statistical Significance.

Effect Sizes.

Can We Achieve Certainty?

Dispelling the Mystique of Statistics.

Research Literacy.

The Discovery Questions.

School Characteristics and Student Learning.

Worker Participation.

The Impact of Technology on the Classroom.

Classroom Observation Data.

Discovery Learning.

Terms and Concepts.

CHAPTER THREE: Using SPSS?

General Features.

Management Functions.

Reading and Importing Data.

Sort.

Split File.

Transform/compute (creating indices).

Merge.

Analysis Functions.

Graphing Functions.

CHAPTER FOUR: CORRELATION.

The Nature of Correlation.

Prediction.

Correlation is not Causation.

Pearson s r.

Strength and Direction.

A Note on the Nature of the Data.

Interpreting Pearson s r.

Testing the Statistical Significance of a Correlation.

The "Practical Significance" of r: Effect Sizes.

An Evaluation Example of Correlation: The Impact of Technology on Teaching and Learning.

Influences on Correlation.

Restricted Range.

Extreme (outlier) Scores.

Other Kinds of Correlation.

A Research Example of Spearman s rho Correlation.

Non Linear Correlation.

"Extending" Correlation to Include Additional Variables.

Correlation – Detail for the Curious.

Computing Pearson s r.

Assumptions of Correlation.

Non–Linear Correlation.

Discovery Learning.

Terms and Concepts.

Practical Application–Correlation.

Description of the Data.

Evaluation Questions.

CHAPTER FIVE: REGRESSION.

The Regression Line – Line of "Best Fit".

The Regression Formula.

Standard Error of Estimate.

Confidence Interval.

Residuals.

Regression Example with Achievement Data.

The Results of the Analysis.

The Graph of the Results.

Standard Error of Estimate.

The Confidence Interval.

Detail – for the curious.

Assumptions of Regression.

Fixed vs. Random Effects Modeling.

Non–Linear Correlation.

Calculating the Standard Error of the Estimate.

Discovery Note.

Terms and Concepts.

Practical Application – Bivariate Regression.

CHAPTER SIX: CLEANING THE DATA – DETECTING OUTLIERS.

Univariate Extreme Scores.

Multivariate Extreme Scores.

Distance Statistics.

Influence Statistics.

Discovery Note.

Terms and Concepts.

Practical Application – Extreme Scores.

CHAPTER SEVEN: MULTIPLE CORRELATION.

Introduction.

Control Variables.

Mediator Variables.

Using Multiple Correlation to Control Variables: Partial & Semi–partial correlation.

Partial Correlation.

Semi–partial (Part) Correlation.

Discovery Note.

Terms and Concepts.

Practical Application – Partial and Semi–Partial Correlation.

CHAPTER EIGHT: MULTIPLE REGRESSION.

Multiple Regression With Two Predictor Variables.

Uses of Multiple Regression.

Multiple Regression Outcomes.

Omnibus Findings for the Overall Model.

Individual Predictors.

Additional SPSS® Results.

Multiple Regression: How to Enter Predictors.

Stepwise Regression and Other Methods.

Assumptions of Multiple Regression.

Multicollinearity.

Cleaning the Database.

Multiple Regression with More Than Two Predictor Variables: Research Examples.

Predicting the Impact of School Variables on Teaching and Learning: the TAGLIT Data.

Omnibus Findings.

Results of Individual Predictors.

Discovery Notes.

Terms and Concepts.

Practical Application: Multiple Regression.

CHAPTER NINE: CODING – USING MLR WITH CATEGORICAL VARIABLES.

Nature of Dummy Variables.

One Categorical Variable with Two Groups.

Creating Dummy Variables.

Creating Subvariables in SPSS®.

One Categorical Variable with More Than Two Groups.

A Hypothetical Example.

An Example from the School Database.

Discovery Notes.

Detail for the Curious.

False Dichotomies.

Discovery Note.

Terms and Concepts.

Practical Application: Dummy Coding.

CHAPTER TEN: INTERACTION.

Interactions with Continuous Variables.

Interaction with Categorical Variables.

Discovery Notes.

Terms and Concepts.

Practical Application – Interaction.

CHAPTER ELEVEN: DISCOVERY LEARNING THROUGH CORRELATION AND REGRESSION.

Overall Discovery Notes.

Findings from the Data.

Student Academic Achievement.

Workplace Participation.

The Impact of Technology on Student Learning.

Advanced Statistical Techniques.

Hierarchical Linear Regression.

Structural Equation Modeling and Path Analysis.

Other Regression Procedures.

CHAPTER TWELVE: PRACTICAL APPLICATION ANALYSES.

Practical Application: Correlation.

Practical Application: Bivariate Regression.

Practical Application: Extreme Scores.

Practical Application: Partial and Semi–Partial Correlation.

Practical Application: Multiple Regression.

Practical Application: Dummy Coding.

Practical Application: Interaction.

REFERENCES.

O autorze

MARTIN LEE ABBOTT, PhD, is Professor of Sociology at Seattle Pacific University, where he also serves as Executive Director of the Washington School Research Center, an independent research and data analysis center funded by the Bill and Melinda Gates Foundation. Dr. Abbott has held positions in both academia and industry, focusing his consulting and teaching in the areas of program evaluation, applied sociology, statistics, and research methods.

Blurb

A hands–on treatment of essential statistical tools for data interpretation and evaluation in research

Across various disciplines, it is important for researchers and professionals to have an advanced understanding of evaluation methods and procedures in order to identify the most valuable meanings and results from gathered data. The Program Evaluation Prism presents a thorough yet accessible guide to the use of regression and correlation methods for formulating questions and dissecting data in order to achieve effective problem solving in evaluation research. Providing detailed coverage in an accessible manner, this book presents the statistical tools necessary to find unobserved patterns that affect daily life, while also guiding readers to discover the dynamics hidden in their own research.

The book begins with a basic introduction to evaluation methodology and its ability to recognize embedded patterns of meaning in research data. Subsequent chapters explore the statistical tools that can be applied irrespective of the design used to generate this data, such as correlation, regression, multiple regression, and detection of extreme scores. The author also provides in–depth coverage of techniques that are not extensively covered in the current literature on the topic, including:

• coding categorical data

• conducting interaction analyses

• order–of–entry methods

• data cleaning

• part and partial correlation

Real–world analyses incorporate meaningful social issues into the discussed techniques, and a final chapter discusses the Practical Application problems found throughout the book. Discover Note and Research Steps sections illustrate how using statistical processes can unveil unobserved patterns and assist readers with identifying such trends in their own data. SPSS® output is included throughout, and a related FTP site features large and small data sets for application of the book′s procedures, SPSS® lab exercises, and access to modules and materials from the author′s own coursework.

The Program Evaluation Prism serves as an excellent book for courses on program evaluation and research methods at the upper–undergraduate and graduate levels. It is also a valuable reference for practitioners, consultants, and researchers who conduct data analysis in the fields of education, psychology, business, and public health.