Models Of Neural Networks Iii: Association, Generalization, And Representation (physics Of Neural Networks)

One of the most challenging and fascinating problems of the theory of neural nets is that of asymptotic behavior, of how a system behaves as time proceeds. This is of particular relevance to many practical applications. Here we focus on association, generalization, and representation. We turn to the last topic first. The introductory chapter, "Global Analysis of Recurrent Neural Net­ works," by Andreas Herz presents an in-depth analysis of how to construct a Lyapunov function for various types of dynamics and neural coding. It includes a review of the recent work with John Hopfield on integrate-and­ fire neurons with local interactions. The chapter, "Receptive Fields and Maps in the Visual Cortex: Models of Ocular Dominance and Orientation Columns" by Ken Miller, explains how the primary visual cortex may asymptotically gain its specific structure through a self-organization process based on Hebbian learning. His argu­ ment since has been shown to be rather susceptible to generalization. Front Matter....Pages i-xiii Global Analysis of Recurrent Neural Networks....Pages 1-54 Receptive Fields and Maps in the Visual Cortex: Models of Ocular Dominance and Orientation Columns....Pages 55-78 Associative Data Storage and Retrieval in Neural Networks....Pages 79-118 Inferences Modeled with Neural Networks....Pages 119-149 Statistical Mechanics of Generalization....Pages 151-209 Bayesian Methods for Backpropagation Networks....Pages 211-254 Penacée: A Neural Net System for Recognizing On-Line Handwriting....Pages 255-279 Topology Representing Network in Robotics....Pages 281-302 Back Matter....Pages 303-311 This collection of articles by leading researchers in neural networks responds to the urgent need for timely and comprehensive reviews in a multidisciplinary, rapidly developing field of research. It continues the themes of the previous volume, but shifts its focus to more practical matters, such as data storage and retrieval, and the recognition of handwriting.