Download Free Vlsi Implementation Of A Digital Neural Network With On Chip Learning Book in PDF and EPUB Free Download. You can read online Vlsi Implementation Of A Digital Neural Network With On Chip Learning and write the review.

This book is an edited selection of the papers presented at the International Workshop on VLSI for Artifidal Intelligence and Neural Networks which was held at the University of Oxford in September 1990. Our thanks go to all the contributors and especially to the programme committee for all their hard work. Thanks are also due to the ACM-SIGARCH, the IEEE Computer Society, and the lEE for publicizing the event and to the University of Oxford and SUNY-Binghamton for their active support. We are particularly grateful to Anna Morris, Maureen Doherty and Laura Duffy for coping with the administrative problems. Jose Delgado-Frias Will Moore April 1991 vii PROLOGUE Artificial intelligence and neural network algorithms/computing have increased in complexity as well as in the number of applications. This in tum has posed a tremendous need for a larger computational power than can be provided by conventional scalar processors which are oriented towards numeric and data manipulations. Due to the artificial intelligence requirements (symbolic manipulation, knowledge representation, non-deterministic computations and dynamic resource allocation) and neural network computing approach (non-programming and learning), a different set of constraints and demands are imposed on the computer architectures for these applications.
Neural network and artificial intelligence algorithrns and computing have increased not only in complexity but also in the number of applications. This in turn has posed a tremendous need for a larger computational power that conventional scalar processors may not be able to deliver efficiently. These processors are oriented towards numeric and data manipulations. Due to the neurocomputing requirements (such as non-programming and learning) and the artificial intelligence requirements (such as symbolic manipulation and knowledge representation) a different set of constraints and demands are imposed on the computer architectures/organizations for these applications. Research and development of new computer architectures and VLSI circuits for neural networks and artificial intelligence have been increased in order to meet the new performance requirements. This book presents novel approaches and trends on VLSI implementations of machines for these applications. Papers have been drawn from a number of research communities; the subjects span analog and digital VLSI design, computer design, computer architectures, neurocomputing and artificial intelligence techniques. This book has been organized into four subject areas that cover the two major categories of this book; the areas are: analog circuits for neural networks, digital implementations of neural networks, neural networks on multiprocessor systems and applications, and VLSI machines for artificial intelligence. The topics that are covered in each area are briefly introduced below.
The early era of neural network hardware design (starting at 1985) was mainly technology driven. Designers used almost exclusively analog signal processing concepts for the recall mode. Learning was deemed not to cause a problem because the number of implementable synapses was still so low that the determination of weights and thresholds could be left to conventional computers. Instead, designers tried to directly map neural parallelity into hardware. The architectural concepts were accordingly simple and produced the so called interconnection problem which, in turn, made many engineers believe it could be solved by optical implementation in adequate fashion only. Furthermore, the inherent fault-tolerance and limited computation accuracy of neural networks were claimed to justify that little effort is to be spend on careful design, but most effort be put on technology issues. As a result, it was almost impossible to predict whether an electronic neural network would function in the way it was simulated to do. This limited the use of the first neuro-chips for further experimentation, not to mention that real-world applications called for much more synapses than could be implemented on a single chip at that time. Meanwhile matters have matured. It is recognized that isolated definition of the effort of analog multiplication, for instance, would be just as inappropriate on the part ofthe chip designer as determination of the weights by simulation, without allowing for the computing accuracy that can be achieved, on the part of the user.
During the 1980s and early 1990s there was signi?cant work in the design and implementation of hardware neurocomputers. Nevertheless, most of these efforts may be judged to have been unsuccessful: at no time have have ha- ware neurocomputers been in wide use. This lack of success may be largely attributed to the fact that earlier work was almost entirely aimed at developing custom neurocomputers, based on ASIC technology, but for such niche - eas this technology was never suf?ciently developed or competitive enough to justify large-scale adoption. On the other hand, gate-arrays of the period m- tioned were never large enough nor fast enough for serious arti?cial-neur- network (ANN) applications. But technology has now improved: the capacity and performance of current FPGAs are such that they present a much more realistic alternative. Consequently neurocomputers based on FPGAs are now a much more practical proposition than they have been in the past. This book summarizes some work towards this goal and consists of 12 papers that were selected, after review, from a number of submissions. The book is nominally divided into three parts: Chapters 1 through 4 deal with foundational issues; Chapters 5 through 11 deal with a variety of implementations; and Chapter 12 looks at the lessons learned from a large-scale project and also reconsiders design issues in light of current and future technology.
Engineers have long been fascinated by how efficient and how fast biological neural networks are capable of performing such complex tasks as recognition. Such networks are capable of recognizing input data from any of the five senses with the necessary accuracy and speed to allow living creatures to survive. Machines which perform such complex tasks as recognition, with similar ac curacy and speed, were difficult to implement until the technological advances of VLSI circuits and systems in the late 1980's. Since then, the field of VLSI Artificial Neural Networks (ANNs) have witnessed an exponential growth and a new engineering discipline was born. Today, many engineering curriculums have included a course or more on the subject at the graduate or senior under graduate levels. Since the pioneering book by Carver Mead; "Analog VLSI and Neural Sys tems", Addison-Wesley, 1989; there were a number of excellent text and ref erence books on the subject, each dealing with one or two topics. This book attempts to present an integrated approach of a single research team to VLSI ANNs Engineering.
This volume contains the proceedings of a workshop on Analog Integrated Neural Systems held May 8, 1989, in connection with the International Symposium on Circuits and Systems. The presentations were chosen to encompass the entire range of topics currently under study in this exciting new discipline. Stringent acceptance requirements were placed on contributions: (1) each description was required to include detailed characterization of a working chip, and (2) each design was not to have been published previously. In several cases, the status of the project was not known until a few weeks before the meeting date. As a result, some of the most recent innovative work in the field was presented. Because this discipline is evolving rapidly, each project is very much a work in progress. Authors were asked to devote considerable attention to the shortcomings of their designs, as well as to the notable successes they achieved. In this way, other workers can now avoid stumbling into the same traps, and evolution can proceed more rapidly (and less painfully). The chapters in this volume are presented in the same order as the corresponding presentations at the workshop. The first two chapters are concerned with fmding solutions to complex optimization problems under a predefmed set of constraints. The first chapter reports what is, to the best of our knowledge, the first neural-chip design. In each case, the physics of the underlying electronic medium is used to represent a cost function in a natural way, using only nearest-neighbor connectivity.
There are many books on neural networks, some of which cover computational intelligence, but none that incorporate both feature extraction and computational intelligence, as Supervised and Unsupervised Pattern Recognition does. This volume describes the application of a novel, unsupervised pattern recognition scheme to the classification of various types of waveforms and images. This substantial collection of recent research begins with an introduction to Neural Networks, classifiers, and feature extraction methods. It then addresses unsupervised and fuzzy neural networks and their applications to handwritten character recognition and recognition of normal and abnormal visual evoked potentials. The third section deals with advanced neural network architectures-including modular design-and their applications to medicine and three-dimensional NN architecture simulating brain functions. The final section discusses general applications and simulations, such as the establishment of a brain-computer link, speaker identification, and face recognition. In the quickly changing field of computational intelligence, every discovery is significant. Supervised and Unsupervised Pattern Recognition gives you access to many notable findings in one convenient volume.
From traditional topics that form the core of industrial electronics, to new and emerging concepts and technologies, The Industrial Electronics Handbook, in a single volume, has the field covered. Nowhere else will you find so much information on so many major topics in the field. For facts you need every day, and for discussions on topics you have only dreamed of, The Industrial Electronics Handbook is an ideal reference.
The human brain, the ultimate intelligent processor, can handle ambiguous and uncertain information adequately. The implementation of such a human-brain architecture and function is called OC brainwareOCO. Brainware is a candidate for the new tool that will realize a human-friendly computer society. As one of the LSI implementations of brainware, a OC bio-inspiredOCO hardware system is discussed in this book. Consisting of eight enriched versions of papers selected from IIZUKA ''98, this volume provides wide coverage, from neuronal function devices to vision systems, chaotic systems, and also an effective design methodology of hierarchical large-scale neural systems inspired by neuroscience. It can serve as a reference for graduate students and researchers working in the field of brainware. It is also a source of inspiration for research towards the realization of a silicon brain. Contents: Neuron MOS Transistor: The Concept and Its Application (T Shibata); Adaptive Learning Neuron Integrated Circuits Using Ferroelectric-Gate FETs (S-M Yoon et al.); An AnalogOCoDigital Merged Circuit Architecture Using PWM Techniques for Bio-Inspired Nonlinear Dynamical Systems (T Morie et al.); Application-Driven Design of Bio-Inspired Low-Power Vision Circuits and Systems (A KAnig et al.); Motion Detection with Bio-Inspired Analog MOS Circuits (H Yonezu et al.); cents MOS Cellular-Automaton Circuit for Picture Processing (M Ikebe & Y Amemiya); Semiconductor Chaos-Generating Elements of Simple Structure and Their Integration (K Hoh et al.); Computation in Single Neuron with Dendritic Trees (N Katayama et al.). Readership: Graduate students, researchers and industrialists in artificial intelligence, neural networks, machine perception, computer vision, pattern/handwriting recognition, image analysis and biocomputing."