Looking Back: Proceedings of a Conference in Honor of Paul W. Holland (Lecture Notes in Statistics Book 202)

In 2006, Paul W. Holland retired from Educational Testing Service (ETS) after a career spanning five decades. In 2008, ETS sponsored a conference, __Looking Back__, honoring his contributions to applied and theoretical psychometrics and statistics. __Looking Back__ attracted a large audience that came to pay homage to Paul Holland and to hear presentations by colleagues who worked with him in special ways over those 40+ years. This book contains papers based on these presentations, as well as vignettes provided by Paul Holland before each section. The papers in this book attest to how Paul Holland's pioneering ideas influenced and continue to influence several fields such as social networks, causal inference, item response theory, equating, and DIF. He applied statistical thinking to a broad range of ETS activities in test development, statistical analysis, test security, and operations. The original papers contained in this book provide historical context for Paul Holland’s work alongside commentary on some of his major contributions by noteworthy statisticians working today. In 2006, Paul W. Holland Retired From Educational Testing Service (ets) After A Career Spanning Five Decades. In 2008, Ets Sponsored A Conference, Looking Back, Honoring His Contributions To Applied And Theoretical Psychometrics And Statistics. Looking Back Attracted A Large Audience That Came To Pay Homage To Paul Holland And To Hear Presentations By Colleagues Who Worked With Him In Special Ways Over Those 40+ Years. This Book Contains Papers Based On These Presentations, As Well As Vignettes Provided By Paul Holland Before Each Section. The Papers In This Book Attest To How Paul Holland's Pioneering Ideas Influenced And Continue To Influence Several Fields Such As Social Networks, Causal Inference, Item Response Theory, Equating, And Dif. he Applied Statistical Thinking To A Broad Range Of Ets Activities In Test Development, Statistical Analysis, Test Security, And Operations. The Original Papers Contained In This Book Provide Historical Context For Paul Holland’s Work Alongside Commentary On Some Of His Major Contributions By Noteworthy Statisticians Working Today. The Contributions Of Paul Holland -- Algebraic Statistics For P1 Random Graph Models -- Mr. Holland's Networks: A Brief Review Of The Importance Of Statistical Studies Of Local Subgraphs Or One Small Tune In A Large Opus -- Some Of My Favorite Things About Working At Ets -- Bayesian Analysis Of A Two-group Randomized Encouragement Design -- The Role Of Nonparametric Analysis In Assessment Modeling: Then And Now -- What Aspects Of The Design Of An Observational Study Affect Its Sensitivity To Bias From Covariates That Were Not Observed? -- The Origins Of Procedures For Using Differential Item Functioning Statistics At Educational Testing Service -- Why I Left Ets And Returned -- Cause Or Effect? Validating The Use Of Tests For High-stakes Inferences In Education -- Propensity Score Matching To Extract Latent Experiments From Nonexperimental Data: A Case Study -- Returning To Ets From Berkeley -- Loglinear Models As Smooth Operators: Holland's Statistical Applications And Their Practical Uses -- Chain Equipercentile Equating And Frequency Estimation Equipercentile Equating: Comparisons Based On Real And Simulated Data -- An Observed-score Equating Framework -- Great Colleagues Make A Great Institution -- An Exploratory Analysis Of Charter Schools -- Holland's Advice For The Fourth Generation Of Test Theory: Blood Tests Can Be Contests. Neil J. Dorans, Sandip Sinharay, Editors. Includes Bibilographical References And Indexes. Front Matter....Pages i-xviii Front Matter....Pages 1-1 The Contributions of Paul Holland....Pages 3-17 Front Matter....Pages 19-20 Algebraic Statistics for p 1 Random Graph Models: Markov Bases and Their Uses....Pages 21-38 Mr. Holland’s Networks: A Brief Review of the Importance of Statistical Studies of Local Subgraphs or One Small Tune in a Large Opus....Pages 39-49 Front Matter....Pages 51-53 Bayesian Analysis of a Two-Group Randomized Encouragement Design....Pages 55-65 The Role of Nonparametric Analysis in Assessment Modeling: Then and Now....Pages 67-85 What Aspects of the Design of an Observational Study Affect Its Sensitivity to Bias from Covariates That Were Not Observed?....Pages 87-114 The Origins of Procedures for Using Differential Item Functioning Statistics at Educational Testing Service....Pages 115-127 Front Matter....Pages 129-129 Cause or Effect? Validating the Use of Tests for High-Stakes Inferences in Education....Pages 131-147 Propensity Score Matching to Extract Latent Experiments from Nonexperimental Data: A Case Study....Pages 149-181 Front Matter....Pages 183-183 Log-Linear Models as Smooth Operators: Holland’s Statistical Applications and Their Practical Uses....Pages 185-202 Chain Equipercentile Equating and Frequency Estimation Equipercentile Equating: Comparisons Based on Real and Simulated Data....Pages 203-219 An Observed-Score Equating Framework....Pages 221-238 Front Matter....Pages 239-239 An Exploratory Analysis of Charter Schools....Pages 241-258 Holland’s Advice for the Fourth Generation of Test Theory: Blood Tests Can Be Contests....Pages 259-272 Back Matter....Pages 273-283 Résumé : In 2006, Paul W. Holland retired from Educational Testing Service (ETS) after a career spanning five decades. In 2008, ETS sponsored a conference, Looking Back , honoring his contributions to applied and theoretical psychometrics and statistics. Looking Back attracted a large audience that came to pay homage to Paul Holland and to hear presentations by colleagues who worked with him in special ways over those 40+ years. This book contains papers based on these presentations, as well as vignettes provided by Paul Holland before each section. The papers in this book attest to how Paul Holland's pioneering ideas influenced and continue to influence several fields such as social networks, causal inference, item response theory, equating, and DIF. He applied statistical thinking to a broad range of ETS activities in test development, statistical analysis, test security, and operations. The original papers contained in this book provide historical context for Paul Holland's work alongside commentary on some of his major contributions by noteworthy statisticians working today.