Information and coding theory in computer science

This book covers different topics from information theory methods and approaches, block and stream coding, lossless data compression, and information and Shannon entropy. Section 1 focuses on information theory methods and approaches, describing information theory of cognitive radio system, information theory and entropies for quantized optical waves in complex time-varying media, some inequalities in information theory using Tsallis entropy, and computational theory of intelligence: information entropy. Section 2 focuses on block and stream coding, describing block-split array coding algorithm for long-stream data compression, bit-error aware lossless image compression with 2d-layer-block coding, beam pattern scanning (BPS) versus space-time block coding (STBC) and space-time trellis coding (STTC), partial feedback based orthogonal space-time block coding with flexible feedback bits, and rate-less space-time block codes for 5g wireless communication systems. Section 3 focuses on lossless data compression, describing lossless image compression technique using combination methods, new results in perceptually lossless compression of hyperspectral images, lossless compression of digital mammography using base switching method, and lossless image compression based on multiple-tables arithmetic coding. Section 4 focuses on information and Shannon entropy, describing entropy as universal concept in sciences, Shannon entropy - axiomatic characterization and application, Shannon entropy in distributed scientific calculations on mobiles ad-hoc networks (MANETs), the computational theory of intelligence: information entropy, and advancing Shannon entropy for measuring diversity in systems. Cover Title Page Copyright DECLARATION ABOUT THE EDITOR TABLE OF CONTENTS List of Contributors List of Abbreviations Preface Section 1: Information Theory Methods and Approaches Chapter 1 Information Theory of Cognitive Radio System Introduction Cognitive Radio Network Paradigms Interference-Mitigating Cognitive Behavior: The Congnitive Radio Channel Interference Avoiding Channel Colloborative Cognitive Channel Comparsions References Chapter 2 Information Theory and Entropies for Quantized Optical Waves in Complex Time-Varying Media Introduction Quantum Optical Waves in Time-Varying Media Information Measures for Thermalized Quantum Optical Fields Husimi Uncertainties and Uncertainty Relations Entropies and Entropic Uncertainty Relations Application to a Special System Summary and Conclusion References Chapter 3 Some Inequalities in Information Theory Using Tsallis Entropy Abstract Introduction Formulation of the Problem Mean Codeword Length and its Bounds Conclusion References Chapter 4 The Computational Theory of Intelligence: Information Entropy Abstract Introduction Entropy Intelligence: Definition and Assumptions Global Effects Applications Related Works Conclusions References Section 2: Block and Stream Coding Chapter 5 Block-Split Array Coding Algorithm for Long-Stream Data Compression Abstract Introduction Problems of Long-Stream Data Compression for Sensors CZ-Array Coding Analyses of CZ-Array Algorithm Experiment Results Conclusions Acknowledgments References Chapter 6 Bit-Error Aware Lossless Image Compression with 2D-Layer-Block Coding Abstract Introduction Related Work on Lossless Compression Our Proposed Method Experiments Conclusions Acknowledgments References Chapter 7 Beam Pattern Scanning (BPS) versus Space-Time Block Coding (STBC) and Space-Time Trellis Coding (STTC) Abstract Introduction Introduction of STBC, STTC and BPS Techniques BPS versus STBC, STTC Simulations Conclusions References Chapter 8 Partial Feedback Based Orthogonal Space-Time Block Coding With Flexible Feedback Bits Abstract Introduction Proposed Code Construction and System Model Linear Decoder at the Receiver Feedback Bits Selection and Properties Simulation Results Conclusions References Chapter 9 Rateless Space-Time Block Codes for 5G Wireless Communication Systems Abstract Introduction Concept of Rateless Codes Rateless Coding and Hybrid Automatic Retransmission Query Rateless Codes’ Literature Review Rateless Codes Applications Motivation to Rateless Space-Time Coding Rateless Space-Time Block Code for Massive MIMO Systems Conclusion References Section 3: Lossless Data Compression Chapter 10 Lossless Image Compression Technique Using Combination Methods Abstract Introduction Literature Review The Proposed Method Conclusions Future Work References Chapter 11 New Results in Perceptually Lossless Compression of Hyperspectral Images Abstract Introduction Data and Approach Experimental Results Conclusion Acknowledgements References Chapter 12 Lossless compression of digital mammography using base switching method Abstract Introduction Base-Switching Algorithm Proposed Method Results Conclusions References Chapter 13 Lossless Image Compression Based on Multiple-Tables Arithmetic Coding Abstract Introduction The MTAC Method Experiments Conclusions References Section 4: Information and Shannon Entropy Chapter 14 Entropy—A Universal Concept in Sciences Abstract Introduction Entropy as a Qualificator of the Configurational Order The Concept of Entropy in Thermodynamics and Statistical Physics The Shannon-Like Entropies Conclusions Appendix Notes References Chapter 15 Shannon entropy: Axiomatic Characterization and Application Introduction Shannon Entropy: Axiomatic Characterization Total Shannon Entropy and Entropy of Continuous Distribution Application: Differential Entropy and Entropy in Classical Statistics Conclusion References Chapter 16 Shannon Entropy in Distributed Scientific Calculations on Mobiles Ad-Hoc Networks (MANETs) Abstract Introduction Measuring the Problem Simulation Conclusion References Chapter 17 Advancing Shannon Entropy for Measuring Diversity in Systems Abstract Introduction Renormalizing Probability: Case-Based Entropy and the Distribution of Diversity Case-Based Entropy of a Continuous Random Variable Results Using Cc to Compare and Contrast Systems Conclusion Acknowledgments References Index Back Cover