Theory of self-adaptive control systems : proceedings of the Second IFAC Symposium on the Theory of Self-Adaptive Control Systems, September 14-17, 1965, National Physical Laboratory, Teddington, England

The basic concept of learning control systems is introduced. Synthesis of learning control systems using statistical decision theory is discussed. Learning is needed if the a priori information is unknown or incompletely known in an adaptive system. The controller will establish the necessary information for control during the system's operation. Two types of learning, with external supervision and without external supervision, have been described. Several learning schemes, including both parametric and nonparametric approaches, have been proposed. Problems of possible computational difficulties and the convergence of learning processes are also discussed. ## DECISION-LEARNING CONTROL SYS'J.'Fl>IS WITH EXTERNAL SUPERVISION In the case of learning with external supervision, the information concerning the correct classification of successive measurement is provided by an external aida "teacher" (Fig. 2). The set of learning measurements 0 may be parti- tioned according to the wi's to which they correspond. It is convenient to assume that learning measurements from one control situation do not provide information about the statistical structure of other control situations. The learning measurements 0 may be considered as k learning measurements from wi. Suppose that, as is usually the case, 0 and the event V E wi are statistically independent, then p{VK+ 1 /uk 1 w.} = p{V(k+l)/VK,uk,wi} p{VK/uk,w.J J. Front Matter....Pages i-xii Front Matter....Pages 1-1 A Class of Learning Control Systems Using Statistical Decision Processes....Pages 3-13 Admissible Adaptive Control....Pages 14-18 A Gradient Method for Determining Optimal Control of Non-Linear Stochastic Systems....Pages 19-27 Summary of Discussion Prediction of the Optimal Control Sequence....Pages 28-31 Front Matter....Pages 33-33 Self-Adaptive Retinal Processes and Their Implications to Adaptive Control....Pages 35-42 Adaptive Functions of Man in Vehicle Control Systems....Pages 43-56 Autonomic Control of Respiration....Pages 57-63 Metabolic Control in the Mammalian Microcirculation....Pages 64-69 The Method of Adaptively Controlled Psychological Learning Experiments....Pages 70-86 General Discussion of Papers on Adaptive Control in Biological Systems....Pages 87-87 Front Matter....Pages 89-89 An Open-Loop Procedure for Process Parameter Estimation Using a Hybrid Computer....Pages 91-95 Numerical Identification of Linear Dynamic Systems from Normal Operating Records....Pages 96-111 Multivariable Models for Control Systems....Pages 112-117 Process Parameter Estimation and Self Adaptive Control....Pages 118-140 General Written Discussion of Papers on Controllers Using Stochastic Decision Processes and System Identification....Pages 141-142 Front Matter....Pages 143-143 Synthesis of Model Reference Adaptive Systems by Liapunov’s Second Method....Pages 145-152 Some Problems of Analytical Synthesis in Model Reference Control Systems by the Direct Method of Lyapunov....Pages 153-156 Basic Properties and Some Dynamics Problems of Adaptive Model Reference Systems....Pages 157-161 Front Matter....Pages 163-163 A Self Adaptive System Employing High Speed Parameter Identification....Pages 165-177 A Non-Linear Self-Adjusting System with Linear Prediction....Pages 178-185 Front Matter....Pages 163-163 Methods of Synthesis of Structures Equivalent to Self-Adjusting Systems for Plants with Variable Parameters....Pages 186-194 On a Method of Synthesising Systems which are Self Adaptive to Varying Parameters....Pages 195-197 An Adaptive Lagging System....Pages 198-203 Some Problems in the Development of Adaptive Systems using the Sensitivity Operator....Pages 204-212 Adaptive Direct Digital Control with Multi-Parameter Adjustment....Pages 213-219 Front Matter....Pages 221-221 Semidynamic Optimal Control....Pages 223-233 A Method for Using Weighting Functions as System Description in Optimal Control....Pages 234-239 An Optimal Control System having a Non-Unique Solution of Pontryagin’s Equations....Pages 240-251 Multi-Level Control Systems....Pages 252-256 On a Method of Compensation against Parametric Disturbances....Pages 257-259 Front Matter....Pages 261-261 A Multi-Dimensional Self-Optimizing Control System Involving Dynamics and Disturbances, Employing Relay Extremum Control....Pages 263-273 The Use of Pseudo-Random Signals in Adaptive Control....Pages 274-280 Limit Cycle Conditions in Optimalizing Controllers....Pages 281-289 Extremum Control in the Presence of Variable Pure Delay....Pages 290-298 Design of the Adaptive Feedback Loop in Parameter-Perturbation Adaptive Controls....Pages 299-308 Some Questions of Learning Optimization of Large-Scale Processes....Pages 309-321 Hillclimbing on Hills with Many Minima....Pages 322-334 Adaptive Optimisation of a Water-Gas Shift Reactor....Pages 335-346 Decoupling in Multidimensional Extrema-Searching Adaptive Control Systems....Pages 347-352 Steady-State Oscillations due to false Switching in Extremum Control Systems....Pages 353-360 Front Matter....Pages 261-261 General Contribution on the Papers on “Control using Perturbation Techniques”....Pages 361-361 Back Matter....Pages 363-363