Simon Haykin

  • State-of-the-art coverage of Kalman filter methods for the design of neural networks This self-contained book consists of seven chapters by expert contributors that discuss Kalman filtering as applied to the training and use of neural networks. Although the traditional approach to the subject is almost always linear, this book recognizes and deals with the fact that real problems are most often nonlinear. The first chapter offers an introductory treatment of Kalman filters with an emphasis on basic Kalman filter theory, Rauch-Tung-Striebel smoother, and the extended Kalman filter. Other chapters cover: An algorithm for the training of feedforward and recurrent multilayered perceptrons, based on the decoupled extended Kalman filter (DEKF) Applications of the DEKF learning algorithm to the study of image sequences and the dynamic reconstruction of chaotic processes The dual estimation problem Stochastic nonlinear dynamics: the expectation-maximization (EM) algorithm and the extended Kalman smoothing (EKS) algorithm The unscented Kalman filter Each chapter, with the exception of the introduction, includes illustrative applications of the learning algorithms described here, some of which involve the use of simulated and real-life data. Kalman Filtering and Neural Networks serves as an expert resource for researchers in neural networks and nonlinear dynamical systems.

  • This collaborative work presents the results of over twenty years of pioneering research by Professor Simon Haykin and his colleagues, dealing with the use of adaptive radar signal processing to account for the nonstationary nature of the environment. These results have profound implications for defense-related signal processing and remote sensing. References are provided in each chapter guiding the reader to the original research on which this book is based.

  • A comprehensive treatment of cognitive radio networks and the specialized techniques used to improve wireless communications The human brain, as exemplified by cognitive radar, cognitive radio, and cognitive computing, inspires the field of Cognitive Dynamic Systems. In particular, cognitive radio is growing at an exponential rate. Fundamentals of Cognitive Radio details different aspects of the human brain and provides examples of how it can be mimicked by cognitive dynamic systems. The text offers a communication-theoretic background, including information on resource allocation in wireless networks and the concept of robustness. The authors provide a thorough mathematical background with data on game theory, variational inequalities, and projected dynamic systems. They then delve more deeply into resource allocation in cognitive radio networks. The text investigates the dynamics of cognitive radio networks from the perspectives of information theory, optimization, and control theory. It also provides a vision for the new world of wireless communications by integration of cellular and cognitive radio networks. This groundbreaking book: Shows how wireless communication systems increasingly use cognition to enhance their networks Explores how cognitive radio networks can be viewed as spectrum supply chain networks Derives analytic models for two complementary regimes for spectrum sharing (open-access and market-driven) to study both equilibrium and disequilibrium behaviors of networks Studies cognitive heterogeneous networks with emphasis on economic provisioning for resource sharing Introduces a framework that addresses the issue of spectrum sharing across licensed and unlicensed bands aimed for Pareto optimality Written for students of cognition, communication engineers, telecommunications professionals, and others, Fundamentals of Cognitive Radio offers a new generation of ideas and provides a fresh way of thinking about cognitive techniques in order to improve radio networks. 

  • Online learning from a signal processing perspective There is increased interest in kernel learning algorithms in neural networks and a growing need for nonlinear adaptive algorithms in advanced signal processing, communications, and controls. Kernel Adaptive Filtering is the first book to present a comprehensive, unifying introduction to online learning algorithms in reproducing kernel Hilbert spaces. Based on research being conducted in the Computational Neuro-Engineering Laboratory at the University of Florida and in the Cognitive Systems Laboratory at McMaster University, Ontario, Canada, this unique resource elevates the adaptive filtering theory to a new level, presenting a new design methodology of nonlinear adaptive filters. Covers the kernel least mean squares algorithm, kernel affine projection algorithms, the kernel recursive least squares algorithm, the theory of Gaussian process regression, and the extended kernel recursive least squares algorithm Presents a powerful model-selection method called maximum marginal likelihood Addresses the principal bottleneck of kernel adaptive filters-their growing structure Features twelve computer-oriented experiments to reinforce the concepts, with MATLAB codes downloadable from the authors' Web site Concludes each chapter with a summary of the state of the art and potential future directions for original research Kernel Adaptive Filtering is ideal for engineers, computer scientists, and graduate students interested in nonlinear adaptive systems for online applications (applications where the data stream arrives one sample at a time and incremental optimal solutions are desirable). It is also a useful guide for those who look for nonlinear adaptive filtering methodologies to solve practical problems.

  • A complete discussion of MIMO communications, from theory to real-world applications The emerging wireless technology Wideband Multiple-Input, Multiple-Output (MIMO) holds the promise of greater bandwidth efficiency and wireless link reliability. This technology is just now being implemented into hardware and working its way into wireless standards such as the ubiquitous 802.11g, as well as third- and fourth-generation cellular standards. Multiple-Input Multiple-Output Channel Models uniquely brings together the theoretical and practical aspects of MIMO communications, revealing how these systems use their multipath diversity to increase channel capacity. It gives the reader a clear understanding of the underlying propagation mechanisms in the wideband MIMO channel, which is fundamental to the development of communication algorithms, signaling strategies, and transceiver design for MIMO systems. MIMO channel models are important tools in understanding the potential gains of a MIMO system. This book discusses two types of wideband MIMO models in detail: correlative channel models-specifically the Kronecker, Weichselberger, and structured models-and cluster models, including Saleh-Valenzuela, European Cooperation in the field of Scientific and Technical Research (COST) 273, and Random Cluster models. From simple to complex, the reader will understand the models' mechanisms and the reasons behind the parameters. Next, channel sounding is explained in detail, presenting the theory behind a few channel sounding techniques used to sound narrowband and wideband channels. The technique of digital matched filtering is then examined and, using real-life data, is shown to provide very accurate estimates of channel gains. The book concludes with a performance analysis of the structured and Kronecker models. Multiple-Input Multiple-Output Channel Models is the first book to apply tensor calculus to the problem of wideband MIMO channel modeling. Each chapter features a list of important references, including core literary references, Matlab implementations of key models, and the location of databases that can be used to help in the development of new models or communication algorithms. Engineers who are working in the development of telecommunications systems will find this resource invaluable, as will researchers and students at the graduate or post-graduate level.

  • Discover cutting-edge research in wireless communications
    This book presents cutting-edge research in wireless communications, particularly in the fast-growing subject of multiple-input multiple-output (MIMO) wireless communication systems. It begins with an introduction, which includes historical notes and a review of turbo-information processing and MIMO wireless communications, and goes on to cover:
    * MIMO channel capacity
    * BLAST architectures
    * Space-time turbo codes and turbo decoding principles
    * Turbo-BLAST
    * Turbo-MIMO systems
    The material is complemented with abundant illustrations and computer experiments that are designed to help readers reinforce their understanding of the underlying subject matter. Space-Time Layered Information Processing for Wireless Communications is an ideal resource for researchers in academia and industry and an excellent textbook for related courses at the graduate level.

  • A handbook on recent advancements and the state of the art in array processing and sensor Networks Handbook on Array Processing and Sensor Networks provides readers with a collection of tutorial articles contributed by world-renowned experts on recent advancements and the state of the art in array processing and sensor networks. Focusing on fundamental principles as well as applications, the handbook provides exhaustive coverage of: wavelets; spatial spectrum estimation; MIMO radio propagation; robustness issues in sensor array processing; wireless communications and sensing in multi-path environments using multi-antenna transceivers; implicit training and array processing for digital communications systems; unitary design of radar waveform diversity sets; acoustic array processing for speech enhancement; acoustic beamforming for hearing aid applications; undetermined blind source separation using acoustic arrays; array processing in astronomy; digital 3D/4D ultrasound imaging technology; self-localization of sensor networks; multi-target tracking and classification in collaborative sensor networks via sequential Monte Carlo; energy-efficient decentralized estimation; sensor data fusion with application to multi-target tracking; distributed algorithms in sensor networks; cooperative communications; distributed source coding; network coding for sensor networks; information-theoretic studies of wireless networks; distributed adaptive learning mechanisms; routing for statistical inference in sensor networks; spectrum estimation in cognitive radios; nonparametric techniques for pedestrian tracking in wireless local area networks; signal processing and networking via the theory of global games; biochemical transport modeling, estimation, and detection in realistic environments; and security and privacy for sensor networks. Handbook on Array Processing and Sensor Networks is the first book of its kind and will appeal to researchers, professors, and graduate students in array processing, sensor networks, advanced signal processing, and networking.

  • Correlative Learning: A Basis for Brain and Adaptive Systems provides a bridge between three disciplines: computational neuroscience, neural networks, and signal processing. First, the authors lay down the preliminary neuroscience background for engineers. The book also presents an overview of the role of correlation in the human brain as well as in the adaptive signal processing world; unifies many well-established synaptic adaptations (learning) rules within the correlation-based learning framework, focusing on a particular correlative learning paradigm, ALOPEX; and presents case studies that illustrate how to use different computational tools and ALOPEX to help readers understand certain brain functions or fit specific engineering applications.

  • Leading experts present the latest research results in adaptive signal processing Recent developments in signal processing have made it clear that significant performance gains can be achieved beyond those achievable using standard adaptive filtering approaches. Adaptive Signal Processing presents the next generation of algorithms that will produce these desired results, with an emphasis on important applications and theoretical advancements. This highly unique resource brings together leading authorities in the field writing on the key topics of significance, each at the cutting edge of its own area of specialty. It begins by addressing the problem of optimization in the complex domain, fully developing a framework that enables taking full advantage of the power of complex-valued processing. Then, the challenges of multichannel processing of complex-valued signals are explored. This comprehensive volume goes on to cover Turbo processing, tracking in the subspace domain, nonlinear sequential state estimation, and speech-bandwidth extension. Examines the seven most important topics in adaptive filtering that will define the next-generation adaptive filtering solutions Introduces the powerful adaptive signal processing methods developed within the last ten years to account for the characteristics of real-life data: non-Gaussianity, non-circularity, non-stationarity, and non-linearity Features self-contained chapters, numerous examples to clarify concepts, and end-of-chapter problems to reinforce understanding of the material Contains contributions from acknowledged leaders in the field Adaptive Signal Processing is an invaluable tool for graduate students, researchers, and practitioners working in the areas of signal processing, communications, controls, radar, sonar, and biomedical engineering.