Statistical Methods for Dynamic Treatment Regimes: Reinforcement Learning, Causal Inference, and Personalized Medicine (Statistics for Biology and Health Book 76)

**Statistical Methods for Dynamic Treatment Regimes** shares state of the art of statistical methods developed to address questions of estimation and inference for dynamic treatment regimes, a branch of personalized medicine. This volume demonstrates these methods with their conceptual underpinnings and illustration through analysis of real and simulated data. These methods are immediately applicable to the practice of personalized medicine, which is a medical paradigm that emphasizes the systematic use of individual patient information to optimize patient health care. This is the first single source to provide an overview of methodology and results gathered from journals, proceedings, and technical reports with the goal of orienting researchers to the field. The first chapter establishes context for the statistical reader in the landscape of personalized medicine. Readers need only have familiarity with elementary calculus, linear algebra, and basic large-sample theory to use this text. Throughout the text, authors direct readers to available code or packages in different statistical languages to facilitate implementation. In cases where code does not already exist, the authors provide analytic approaches in sufficient detail that any researcher with knowledge of statistical programming could implement the methods from scratch. This will be an important volume for a wide range of researchers, including statisticians, epidemiologists, medical researchers, and machine learning researchers interested in medical applications. Advanced graduate students in statistics and biostatistics will also find material in Statistical Methods for Dynamic Treatment Regimes to be a critical part of their studies. Presents Statistical Methods Developed To Address Questions Of Estimation And Inference For Dynamic Treatment Regimes, A Branch Of Personalized Medicine. These Methods Are Demonstrated With Their Conceptual Underpinnings And Illustration Through Analysis Of Real And Simulated Data, And Their Application To The Practice Of Personalized Medicine, Which Emphasizes The Systematic Use Of Individual Patient Information To Optimize Patient Health Care. Provides An Overview Of Methodology And Results Gathered From Journals, Proceedings, And Technical Reports With The Goal Of Orienting Researchers To The Field. Readers Need Familiarity With Elementary Calculus, Linear Algebra, And Basic Large-sample Theory To Use This Text. Throughout The Text, Authors Direct Readers To Available Code Or Packages In Different Statistical Languages To Facilitate Implementation. In Cases Where Code Does Not Already Exist, The Authors Provide Analytic Approaches In Sufficient Detail That Any Researcher With Knowledge Of Statistical Programming Could Implement The Methods From Scratch. Applicable To A Wide Range Of Researchers, Including Statisticians, Epidemiologists, Medical Researchers, And Machine Learning Researchers Interested In Medical Applications, As Well As Advanced Graduate Students In Statistics And Biostatistics. Introduction -- The Data : Observational Studies And Sequentially Randomized Trials -- Statistical Reinforcement Learning -- Semi-parametric Estimation Of Optimal Dtrs By Modeling Contrasts Of Conditional Mean Outcomes -- Estimation Of Optimal Dtrs By Directly Modeling Regimes -- G-computation: Parametric Estimation Of Optimal Dtrs -- Estimation Dtrs For Alternative Outcome Types -- Inference And Non-regularity -- Additional Considerations And Final Thoughts. Bibhas Chakraborty, Erica E.m. Moodie. Includes Bibliographical References (pages 185-201) And Index. Front Matter....Pages i-xvi Introduction....Pages 1-8 The Data: Observational Studies and Sequentially Randomized Trials....Pages 9-30 Statistical Reinforcement Learning....Pages 31-52 Semi-parametric Estimation of Optimal DTRs by Modeling Contrasts of Conditional Mean Outcomes....Pages 53-78 Estimation of Optimal DTRs by Directly Modeling Regimes....Pages 79-100 G-computation: Parametric Estimation of Optimal DTRs....Pages 101-112 Estimation of DTRs for Alternative Outcome Types....Pages 113-125 Inference and Non-regularity....Pages 127-168 Additional Considerations and Final Thoughts....Pages 169-180 Back Matter....Pages 181-204